-- Logs begin at Wed 2021-11-24 15:31:56 UTC, end at Wed 2021-11-24 16:43:48 UTC. -- Nov 24 16:13:59.003569 dv-cinder-819007-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 24 16:14:01.747593 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.common.config [-] Logging enabled! Nov 24 16:14:01.748712 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 16:14:01.748922 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102996) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 16:14:01.752219 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.common.config [-] Logging enabled! Nov 24 16:14:01.752478 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev224 Nov 24 16:14:01.752795 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102996) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 16:14:01.753745 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:14:01.753990 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 16:14:01.754364 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:14:01.754619 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 16:14:01.754852 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 16:14:01.755201 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.755636 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 24 16:14:01.755959 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.756263 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.756561 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.756862 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.757157 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.757443 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.757738 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.758042 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.758331 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.758615 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.758919 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.759240 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.759530 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.759824 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.760119 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.760407 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] debug = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.760696 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.761135 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.761556 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.761843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.762281 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.762428 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.762706 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.763014 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.763309 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.763643 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] host = dv-cinder-819007-2-iscsi {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.764561 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.764858 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.765153 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.765446 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.765727 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.766011 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.766302 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.766582 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.766859 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.767167 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.767462 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.767759 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.768053 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.768284 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.768511 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.768805 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.769096 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.769376 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.769655 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.769934 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.770214 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.770493 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.770768 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.771089 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.771383 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.771676 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.771955 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.772235 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.772512 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.772789 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.773081 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.773365 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.773641 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.773918 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.774209 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.774483 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.774762 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.775101 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.775395 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.775684 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.775974 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.776252 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.776540 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.776815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.777091 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.777368 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_json = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.777644 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.777916 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.778201 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.778479 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.778754 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.779057 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.779336 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.779647 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:01.779948 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.780251 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.780558 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.780848 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.781156 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.781441 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.781737 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.782018 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.782310 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.782602 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.782892 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.783196 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.783494 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.783777 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.784077 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.784385 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.784685 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.784984 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.785265 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.785547 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.785829 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.786113 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.786405 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.786689 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.787017 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.787316 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.787601 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.787906 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.788197 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.788498 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.788799 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.789085 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.789374 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.789674 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.789960 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.790241 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.790528 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.790825 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.791135 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.791417 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.791706 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.791990 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.792270 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.792549 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.792835 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.793134 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.793424 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.793701 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.793977 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.794260 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.794537 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.794826 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.795170 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.795455 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.795735 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.796022 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.796302 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.796580 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.796863 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.797140 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.797423 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.797700 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.797979 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.798256 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.798533 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.798809 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.799112 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.799390 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.799673 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.799950 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.800226 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.800506 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.800784 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.801063 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.801352 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.801655 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.801938 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.802220 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.802501 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.802783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.803092 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.803387 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.803670 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.803954 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.804232 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.804526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.804816 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.805108 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.805397 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.805714 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.806016 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.806298 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.806586 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.806867 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.807176 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.807464 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.807753 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.808051 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.808348 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.808645 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.808942 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.809238 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.809529 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.809841 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.810124 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:01.810349 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 16:14:01.810594 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102996) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 24 16:14:02.243420 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:02.243708 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:02.244022 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:02.244372 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 24 16:14:02.577922 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.578217 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.578495 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.579713 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.579994 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.580386 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.617160 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.617445 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.617718 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.631712 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.632005 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.632281 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.661371 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.661658 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.661935 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.699890 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.700179 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.700455 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.952108 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.952715 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.952715 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.952899 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:02.953516 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.050873 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.051217 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.051501 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.051773 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.052038 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.052346 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.052605 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.052859 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.053111 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.053390 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.053646 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.053906 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.054161 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.054410 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.054665 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.054943 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.055201 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.055466 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.055733 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.055988 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.056258 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.056507 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.056788 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.057161 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.057407 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.057650 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.058035 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.058273 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.058506 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.058741 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.059003 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.059240 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:03.059593 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 24 16:14:03.063246 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 24 16:14:03.067156 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 24 16:14:03.070783 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])]) Nov 24 16:14:03.072564 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 24 16:14:03.073024 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 24 16:14:03.073355 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 24 16:14:03.073738 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 24 16:14:03.077179 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 24 16:14:03.077428 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 24 16:14:03.077770 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 16:14:03.083047 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 24 16:14:03.105569 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 24 16:14:03.106022 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.106321 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102996) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 24 16:14:03.106681 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.108122 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102996) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 24 16:14:03.108404 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 16:14:03.108650 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 24 16:14:03.112080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.112363 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:03.175535 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 24 16:14:03.175776 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 24 16:14:03.176010 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 24 16:14:03.176382 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 24 16:14:03.198508 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_db.sqlalchemy.engines [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:14:04.120291 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing driver for type 'gre' Nov 24 16:14:04.120822 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] gre ID ranges: [(1, 1000)] Nov 24 16:14:04.323318 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing driver for type 'local' Nov 24 16:14:04.323665 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing driver for type 'vlan' Nov 24 16:14:04.412326 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] VlanTypeDriver initialization complete Nov 24 16:14:04.412800 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing driver for type 'vxlan' Nov 24 16:14:04.413699 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] vxlan ID ranges: [(1, 1000)] Nov 24 16:14:04.568896 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing extension driver 'port_security' Nov 24 16:14:04.569242 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.extensions.port_security [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] PortSecurityExtensionDriver initialization complete Nov 24 16:14:04.569589 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing mechanism driver 'openvswitch' Nov 24 16:14:04.569925 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing mechanism driver 'hyperv' Nov 24 16:14:04.577186 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.plugin [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102996) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:04.577873 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.578254 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.578614 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.579178 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.579621 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.579986 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.580345 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.580764 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.581218 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.581579 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.581931 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.582339 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.582751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.583133 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.583486 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.586199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.586656 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > address_group after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586656 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > address_group after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.586656 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.587086 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102996) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 16:14:04.587472 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] ML2 OVO RPC backend initialized. {{(pid=102996) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 24 16:14:04.588181 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.588545 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.588967 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.589323 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > networks before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.589684 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.590038 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > ports before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.590692 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.591069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnets before_response 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.591425 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.591777 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.592193 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.592540 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.592886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.593227 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.593573 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.593915 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.594263 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.594845 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.plugin [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Modular L2 Plugin initialization complete Nov 24 16:14:04.595206 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading services supported by the core plugin {{(pid=102996) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 24 16:14:04.595541 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.plugins.ml2.managers [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Got port-security extension from driver 'port_security' Nov 24 16:14:04.596014 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.extensions.vlantransparent [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Disabled vlantransparent extension. Nov 24 16:14:04.596536 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102996) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 24 16:14:04.596860 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: router Nov 24 16:14:04.632799 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.633198 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_create 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.633578 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router before_create 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.633953 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.634337 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.634703 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_delete 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.635102 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.635464 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.635832 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_create 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.636185 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.636541 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.636893 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.637260 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.637679 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.638053 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.638402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.639391 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: subnet after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.639751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.640112 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.640476 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_create 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.640835 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.641193 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.641562 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router after_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.641917 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.642282 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_create 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.642656 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.643046 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_update 55549900 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.643424 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > agent after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.643785 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > agent after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.644143 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > network after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.645007 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Tracking information for resource: router configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:04.645353 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Tracking information for resource: floatingip configured {{(pid=102996) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 16:14:04.650361 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.db.l3_agentschedulers_db [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 24 16:14:04.650975 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.651344 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.651705 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.652063 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: port after_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.652850 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router before_create 55550100 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.653221 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.653591 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_create 55550100 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.653955 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > router precommit_update 55550100 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.658827 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.provider_configuration [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service providers = [] {{(pid=102996) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 24 16:14:04.659227 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.db.servicetype_db [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102996) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 24 16:14:04.662204 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.service_base [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102996) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 16:14:04.662607 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.service_base [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102996) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 16:14:04.662938 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.service_base [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102996) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 16:14:04.663843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.services.service_base [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102996) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 16:14:04.664225 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.services.service_base [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 24 16:14:04.664607 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.664936 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 24 16:14:04.675773 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.676121 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: auto_allocate Nov 24 16:14:04.682011 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: network precommit_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.682396 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: network precommit_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.682953 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.683288 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: tag Nov 24 16:14:04.690454 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.690801 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: timestamp Nov 24 16:14:04.695939 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.696273 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: network_ip_availability Nov 24 16:14:04.702355 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.702737 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.703138 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.703855 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.704182 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: flavors Nov 24 16:14:04.709014 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.709359 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading Plugin: revisions Nov 24 16:14:04.722493 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102996) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 16:14:04.722895 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.479s {{(pid=102996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:04.723675 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102996) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 24 16:14:04.724022 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Initializing extension manager. Nov 24 16:14:04.724551 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: __init__.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.724903 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: __pycache__ {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.725249 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.725589 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: address_group.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.726356 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.726950 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: address-group Nov 24 16:14:04.727285 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: address_scope.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.728245 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.728765 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: address-scope Nov 24 16:14:04.729101 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.730063 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.730577 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: router-admin-state-down-before-update Nov 24 16:14:04.730924 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: agent.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.731654 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.732163 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: agent Nov 24 16:14:04.732525 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: agent_resources_synced.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.733499 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.734018 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: agent-resources-synced Nov 24 16:14:04.734349 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: allowedaddresspairs.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.736177 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.736709 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: allowed-address-pairs Nov 24 16:14:04.737046 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: auto_allocated_topology.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.738139 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.738665 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: auto-allocated-topology Nov 24 16:14:04.739021 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: availability_zone.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.739769 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.740286 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: availability_zone Nov 24 16:14:04.740618 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: availability_zone_filter.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.741551 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.742070 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: availability_zone_filter Nov 24 16:14:04.742401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: data_plane_status.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.743351 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.743868 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension data-plane-status not supported by any of loaded plugins Nov 24 16:14:04.744197 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: default_subnetpools.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.745127 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.745643 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: default-subnetpools Nov 24 16:14:04.745972 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.746789 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.747379 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: dhcp_agent_scheduler Nov 24 16:14:04.752496 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: dns.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.753206 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.753728 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension dns-integration not supported by any of loaded plugins Nov 24 16:14:04.754060 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: dns_domain_ports.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.755028 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.755547 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 24 16:14:04.755878 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.756819 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.757331 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 24 16:14:04.757661 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: dvr.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.758339 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.758855 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: dvr Nov 24 16:14:04.759256 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: ecmp_routes.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.760199 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.760709 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 24 16:14:04.761040 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: empty_string_filtering.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.761968 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.762481 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: empty-string-filtering Nov 24 16:14:04.762812 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.764353 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.764867 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 24 16:14:04.765198 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.766129 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.766639 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 24 16:14:04.766995 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: external_net.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.767924 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.768440 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: external-net Nov 24 16:14:04.768769 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.769699 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.770217 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: extra_dhcp_opt Nov 24 16:14:04.770548 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: extraroute.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.771548 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.772061 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: extraroute Nov 24 16:14:04.772388 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: extraroute_atomic.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.773435 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.773961 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: extraroute-atomic Nov 24 16:14:04.774291 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: filter_validation.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.775001 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.775514 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: filter-validation Nov 24 16:14:04.775844 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: fip_pf_description.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.776775 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.777288 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 24 16:14:04.777617 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: fip_port_details.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.778588 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.779125 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: fip-port-details Nov 24 16:14:04.779482 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: flavors.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.780734 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.781257 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: flavors Nov 24 16:14:04.781592 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.783353 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.783890 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 24 16:14:04.784227 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: floatingip_pools.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.784948 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.785471 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: floatingip-pools Nov 24 16:14:04.785807 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: ip_allocation.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.786756 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.787297 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension ip_allocation not supported by any of loaded plugins Nov 24 16:14:04.787630 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.788574 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.789096 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: ip-substring-filtering Nov 24 16:14:04.789428 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l2_adjacency.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.790399 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.790933 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 24 16:14:04.791273 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.792386 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.792912 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: router Nov 24 16:14:04.793245 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.795600 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.796181 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 24 16:14:04.796523 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.808703 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.809232 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: ext-gw-mode Nov 24 16:14:04.809567 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.810520 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.811576 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: l3-ha Nov 24 16:14:04.811910 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3_flavors.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.812849 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.813607 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: l3-flavors Nov 24 16:14:04.813921 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.814654 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.815203 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 24 16:14:04.815534 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: l3agentscheduler.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.816570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.817090 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: l3_agent_scheduler Nov 24 16:14:04.817510 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: local_ip.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.819345 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.819914 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension local_ip not supported by any of loaded plugins Nov 24 16:14:04.820254 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: logging.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.821761 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.822287 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension logging not supported by any of loaded plugins Nov 24 16:14:04.822628 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: metering.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.823423 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.824008 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: metering Nov 24 16:14:04.824344 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.825508 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.826027 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: metering_source_and_destination_fields Nov 24 16:14:04.826931 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: multiprovidernet.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.827878 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.828399 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: multi-provider Nov 24 16:14:04.828734 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: netmtu.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.829663 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.830180 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: net-mtu Nov 24 16:14:04.830514 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: netmtu_writable.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.831527 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.832048 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: net-mtu-writable Nov 24 16:14:04.832465 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: network_availability_zone.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.836767 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.836767 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: network_availability_zone Nov 24 16:14:04.836767 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: network_ip_availability.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.837679 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.838205 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: network-ip-availability Nov 24 16:14:04.838542 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: network_segment_range.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.839438 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.839955 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension network-segment-range not supported by any of loaded plugins Nov 24 16:14:04.840545 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: pagination.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.843137 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.843497 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: pagination Nov 24 16:14:04.843844 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: port_device_profile.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.844785 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.845315 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: port-device-profile Nov 24 16:14:04.845652 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.846598 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.847155 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: port-mac-address-regenerate Nov 24 16:14:04.847526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.848466 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.848986 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: port-numa-affinity-policy Nov 24 16:14:04.849318 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: port_resource_request.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.850263 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.850774 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension port-resource-request not supported by any of loaded plugins Nov 24 16:14:04.851137 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: port_resource_request_groups.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.852126 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.852640 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 24 16:14:04.852975 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: portbindings.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.853961 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.854470 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: binding Nov 24 16:14:04.854802 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: portbindings_extended.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.856151 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.856681 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: binding-extended Nov 24 16:14:04.857019 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: portsecurity.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.857985 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.858512 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: port-security Nov 24 16:14:04.858846 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: project_id.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.859876 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.860283 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: project-id Nov 24 16:14:04.860615 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: providernet.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.872205 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.872725 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: provider Nov 24 16:14:04.873570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.877332 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.877860 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos not supported by any of loaded plugins Nov 24 16:14:04.878203 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.879499 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.880024 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 24 16:14:04.880361 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.881304 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.881824 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 24 16:14:04.882157 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_default.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.883169 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.883687 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-default not supported by any of loaded plugins Nov 24 16:14:04.884019 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_fip.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.884685 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.885198 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-fip not supported by any of loaded plugins Nov 24 16:14:04.885528 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_gateway_ip.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.886472 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.887089 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 24 16:14:04.887422 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_port_network_policy.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.888415 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.889546 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 24 16:14:04.889876 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.890968 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.891493 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 24 16:14:04.891826 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_pps_rule.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.893029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.893549 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-pps not supported by any of loaded plugins Nov 24 16:14:04.893887 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_rule_type_details.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.894838 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.895381 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 24 16:14:04.895715 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: qos_rules_alias.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.896818 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.897330 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 24 16:14:04.897663 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: quota_check_limit.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.900869 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.901385 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: quota-check-limit Nov 24 16:14:04.901717 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: quotasv2.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.902649 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.903014 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: quotas Nov 24 16:14:04.903344 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: quotasv2_detail.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.906805 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.907194 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: quota_details Nov 24 16:14:04.907538 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: rbac.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.908608 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.909146 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: rbac-policies Nov 24 16:14:04.909488 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: rbac_address_group.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.910440 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.911066 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: rbac-address-group Nov 24 16:14:04.911408 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: rbac_address_scope.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.912364 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.912933 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: rbac-address-scope Nov 24 16:14:04.913222 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: rbac_security_groups.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.914166 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.914683 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: rbac-security-groups Nov 24 16:14:04.915054 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: rbac_subnetpool.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.915994 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.916511 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: rbac-subnetpool Nov 24 16:14:04.916847 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: revisionifmatch.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.917798 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.918318 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: revision-if-match Nov 24 16:14:04.918733 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: revisions.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.919954 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.920475 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: standard-attr-revisions Nov 24 16:14:04.920812 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: router_availability_zone.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.921508 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.922026 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: router_availability_zone Nov 24 16:14:04.922388 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: routerservicetype.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.923356 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.923869 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension router-service-type not supported by any of loaded plugins Nov 24 16:14:04.924202 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.925252 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.925771 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: security-groups-normalized-cidr Nov 24 16:14:04.926106 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.927084 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.927604 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: port-security-groups-filtering Nov 24 16:14:04.927938 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.928888 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.929407 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: security-groups-remote-address-group Nov 24 16:14:04.929742 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.930690 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.931249 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: security-groups-shared-filtering Nov 24 16:14:04.931585 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.932186 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 24 16:14:04.932516 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: securitygroup.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.942858 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.943416 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: security-group Nov 24 16:14:04.943759 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: segment.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.944560 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.945079 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension segment not supported by any of loaded plugins Nov 24 16:14:04.945415 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.946379 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.946897 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 24 16:14:04.947252 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: servicetype.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.948376 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.948908 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: service-type Nov 24 16:14:04.949248 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: sorting.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.950253 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.950599 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: sorting Nov 24 16:14:04.950951 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: standard_attr_segment.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.952493 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.953020 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 24 16:14:04.953357 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: standardattrdescription.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.954022 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.954540 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: standard-attr-description Nov 24 16:14:04.954873 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: stateful_security_group.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.955862 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.956385 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: stateful-security-group Nov 24 16:14:04.956721 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: stdattrs_common.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.957305 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 24 16:14:04.957633 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.958590 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.959149 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 24 16:14:04.959482 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnet_onboard.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.960575 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.961110 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: subnet_onboard Nov 24 16:14:04.961440 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.962401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.962929 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 24 16:14:04.963270 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnet_service_types.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.964216 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.964737 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: subnet-service-types Nov 24 16:14:04.965310 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnetallocation.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.966439 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.967031 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: subnet_allocation Nov 24 16:14:04.967371 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.968053 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.968572 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: subnetpool-prefix-ops Nov 24 16:14:04.968903 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.969863 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.970381 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 24 16:14:04.970712 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: tagging.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.971816 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.972355 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: standard-attr-tag Nov 24 16:14:04.972691 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: timestamp.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.973907 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.974429 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loaded extension: standard-attr-timestamp Nov 24 16:14:04.974765 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: trunk.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.975860 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.976382 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension trunk not supported by any of loaded plugins Nov 24 16:14:04.976720 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: trunk_details.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.977675 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.978197 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension trunk-details not supported by any of loaded plugins Nov 24 16:14:04.978531 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: uplink_status_propagation.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.979513 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.980032 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 24 16:14:04.980367 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Loading extension file: vlantransparent.py {{(pid=102996) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 16:14:04.981060 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102996) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 16:14:04.981574 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 24 16:14:04.984628 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:network Nov 24 16:14:04.985167 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnet Nov 24 16:14:04.985583 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 16:14:04.985996 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:port Nov 24 16:14:04.987255 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.987846 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service FLAVORS assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.988477 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.988913 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.989256 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:router Nov 24 16:14:04.989702 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 16:14:04.990197 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service METERING assigned prefix: /metering {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.991655 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.992037 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.992408 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102996) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:14:04.993406 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 16:14:04.993848 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:security_group Nov 24 16:14:04.994296 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 16:14:04.995002 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service CORE assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.995345 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 16:14:04.995700 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] subnetpool is already registered Nov 24 16:14:04.996173 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service CORE assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:04.996511 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 16:14:04.996854 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] subnetpool is already registered Nov 24 16:14:04.999728 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.000172 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service FLAVORS assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.000764 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.001196 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.001539 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:router Nov 24 16:14:05.001883 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] router is already registered Nov 24 16:14:05.002332 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 16:14:05.002674 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] floatingip is already registered Nov 24 16:14:05.003170 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service METERING assigned prefix: /metering {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.003842 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 16:14:05.004176 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] rbac_policy is already registered Nov 24 16:14:05.004592 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:security_group Nov 24 16:14:05.004934 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] security_group is already registered Nov 24 16:14:05.005339 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 16:14:05.005676 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] security_group_rule is already registered Nov 24 16:14:05.006309 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service CORE assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.006646 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 16:14:05.007014 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] subnetpool is already registered Nov 24 16:14:05.007440 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.v2.resource_helper [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Service CORE assigned prefix: {{(pid=102996) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 16:14:05.007772 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 16:14:05.008110 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING neutron.quota.resource_registry [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] subnetpool is already registered Nov 24 16:14:05.008588 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: extensions {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.010053 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: address-groups {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.011558 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: address-scopes {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.012888 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: agents {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.014076 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: auto-allocated-topology {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.015341 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: availability_zones {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.016556 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: dhcp-networks {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.018089 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: dhcp-agents {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.019601 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: routers {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.021873 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: flavors {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.023065 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: service_profiles {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.024269 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: next_providers {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.025718 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: service_profiles {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.027288 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: floatingip-pools {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.028510 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: routers {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.030646 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: floatingips {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.032885 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: l3-routers {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.034296 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: l3-agents {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.035730 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: metering-labels {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.037090 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: metering-label-rules {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.038373 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: network-ip-availabilities {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.039668 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: bindings {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.041312 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: quotas {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.042861 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: quotas {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.044474 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: rbac-policies {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.046287 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: security-groups {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.047551 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: security-group-rules {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.048773 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: service-providers {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.049978 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: subnetpools {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.051409 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: subnetpools {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.052881 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.054563 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.056399 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.058152 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.059985 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.062396 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.064112 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.066010 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.067809 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.069654 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron.api.extensions [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Extended resource: tags {{(pid=102996) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 16:14:05.075719 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING keystonemiddleware.auth_token [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 16:14:05.080382 dv-cinder-819007-2-iscsi neutron-server[102996]: WARNING keystonemiddleware.auth_token [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 16:14:05.089201 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Acquired lock "singleton_lock" {{(pid=102996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 16:14:05.089679 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_concurrency.lockutils [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Releasing lock "singleton_lock" {{(pid=102996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 16:14:05.090586 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Starting 2 workers Nov 24 16:14:05.095498 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Started child 103141 {{(pid=102996) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 16:14:05.102825 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Started child 103142 {{(pid=102996) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 16:14:05.103570 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.104104 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO neutron.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 24 16:14:05.104104 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Publish callbacks [] for process, before_spawn {{(pid=102996) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.104248 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [-] (103141) wsgi starting up on http://0.0.0.0:9696 Nov 24 16:14:05.104760 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Starting 1 workers Nov 24 16:14:05.105348 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.106708 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [-] (103142) wsgi starting up on http://0.0.0.0:9696 Nov 24 16:14:05.110582 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Started child 103143 {{(pid=102996) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 16:14:05.111154 dv-cinder-819007-2-iscsi neutron-server[102996]: INFO oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Starting 1 workers Nov 24 16:14:05.114333 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] calling RpcWorker wait() {{(pid=103143) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 24 16:14:05.114861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] returning from RpcWorker wait() {{(pid=103143) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 24 16:14:05.115700 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Started child 103144 {{(pid=102996) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 16:14:05.116476 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.116576 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG neutron_lib.callbacks.manager [None req-c64bee63-1a92-4c00-ac59-8335dff70d05 None None] Publish callbacks [] for process, after_spawn {{(pid=102996) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.117336 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:05.118710 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102996) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 16:14:05.118943 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:14:05.119143 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 16:14:05.119371 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:14:05.119720 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 16:14:05.119906 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 16:14:05.120529 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.121031 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.121101 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:05.121489 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.121489 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.121624 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.121977 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:05.122169 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.122455 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.122692 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.122984 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.123844 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.124020 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.124195 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.124457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.124690 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.125000 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.125281 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.125534 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.125802 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.125975 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.126243 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.126518 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.126751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.127036 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] debug = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.127294 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.127796 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.128025 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.128285 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.128522 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.128805 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.129049 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.129314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.129575 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.129813 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.130037 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.130303 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.130539 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.130751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.131014 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.131232 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.131492 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.131714 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.132181 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] host = dv-cinder-819007-2-iscsi {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.132421 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.132643 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.132871 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.133118 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.133365 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.133579 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.133830 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.134074 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.134324 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.134585 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.134820 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.135102 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.135341 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.135585 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.135752 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_options = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.136002 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.136285 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.136594 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.136730 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.136933 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.137061 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.137315 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.137481 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.137743 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.137981 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.138198 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.138429 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.138668 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.138935 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.139209 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.139447 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.139665 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.139902 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.140168 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.140399 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.140650 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.140879 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.141118 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.141352 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.141568 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.141794 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.142024 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.142262 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.142520 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.142743 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.142999 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.143268 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.143520 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.143760 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.144035 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.144270 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.144501 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.144753 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.145029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.145259 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.145512 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.145783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.146021 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.146250 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.146468 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.146704 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.146972 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_json = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.147171 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.147420 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.147668 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.147904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.148121 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.148343 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.148560 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.148805 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.149227 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.149526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.149832 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.151243 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.151495 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.151752 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.151997 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.152245 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.152502 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.152761 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.153063 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.153320 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.153647 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.155157 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.155157 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.155742 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.156116 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.156326 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.156570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.156833 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.157084 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.157342 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.157640 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.157877 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.158120 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.158361 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.158635 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.158941 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.159237 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.159582 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.159868 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.160127 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.160390 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.160639 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.160915 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.161119 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.161337 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.161855 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.161855 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.162151 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.162293 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.162477 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.162775 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.170810 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.171524 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172050 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.172581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173145 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173621 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173621 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.173795 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.174230 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.174332 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.174598 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.174866 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.175151 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.175374 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.175637 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.175858 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.176144 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.176374 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.176598 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.176838 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.177114 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.177365 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.177622 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.177851 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.178074 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.178345 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.178576 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.178816 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.179063 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.179319 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.179544 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.179799 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.180062 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.180295 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.180547 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.180777 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.181055 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.181302 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.181528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43544) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:05.181709 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.181864 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.182069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.182504 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.182782 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.183071 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.183327 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.183600 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.185026 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.185026 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.185026 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.185026 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.186388 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.186388 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.186672 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.186672 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.186989 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.187148 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.187415 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.187862 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.188020 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.188217 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.188374 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.188607 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.188874 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.189347 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191134 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191134 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191134 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191606 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [-] 10.222.0.82 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0068691 Nov 24 16:14:05.191766 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191766 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191766 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.191766 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.192305 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.192305 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.192305 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.192731 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.192731 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.193181 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.193181 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.193386 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.193634 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.196278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.198187 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.198466 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.198963 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.199349 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.200815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.200815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.200815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.200815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.200815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.201783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.201783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.201783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.201783 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.202320 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.202474 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.202661 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.202973 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.204923 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.205170 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.205404 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.205650 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.205888 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.206113 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.206356 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.206997 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.207619 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.207619 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.207852 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.208057 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.208278 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.209119 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.209392 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.209648 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.210225 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.210501 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.210756 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.211029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.211397 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.211577 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.211789 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.212014 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.212749 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.212853 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.218966 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.219343 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.219631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.219887 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.220165 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.220405 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.220637 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.220886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.221116 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.221342 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.221656 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.221833 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.222045 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.222284 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.222502 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.222721 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.222990 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.223242 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.223506 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.223742 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.223960 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.224178 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.224407 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.224631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.224845 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.225101 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.225390 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.225525 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.225753 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.225980 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.226195 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.226427 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.226642 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.226857 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.228114 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.228933 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.229204 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.229525 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.229811 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.230055 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.230363 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.230634 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.230978 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.231209 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.233224 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.233224 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.233385 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234699 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.234884 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.235133 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.235396 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.235692 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.236011 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.236259 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.237941 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.237941 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.238101 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.238296 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.238946 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.238946 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.239144 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.239338 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.239570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.239826 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.240074 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.240322 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.240571 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.240831 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.241363 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.241363 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.241607 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.241793 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.242055 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.242297 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.242545 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.243778 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.243778 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 16:14:05.244160 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102996) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 16:14:05.245069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:14:05.245069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 16:14:05.245069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:14:05.245069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 16:14:05.245069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 16:14:05.245458 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.245458 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.245458 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.245637 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247088 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247088 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247088 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247301 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247301 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247438 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247585 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247752 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.247904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.248637 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.248815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.248985 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249154 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249319 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249487 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249651 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249822 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.249988 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.250153 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] debug = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.250319 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.250540 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.251589 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.251761 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.251924 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252086 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252248 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252426 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252736 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.252899 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253065 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253227 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253390 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253553 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253716 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.253878 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254042 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254204 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] host = dv-cinder-819007-2-iscsi {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254367 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254530 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254692 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.254854 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.255842 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256014 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256166 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256331 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256498 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256646 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256804 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.256970 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257133 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257297 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257459 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_options = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257622 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257785 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.257948 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.258141 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.258312 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.258476 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.258639 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.258800 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259001 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259157 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259322 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259484 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259647 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259814 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.259977 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.260139 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261029 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261636 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261636 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261636 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.261636 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262041 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262041 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262289 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262289 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262764 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.262929 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263051 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263159 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263319 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263482 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263672 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.263857 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264020 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264187 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264380 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264535 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264684 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.264829 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_json = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265631 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265960 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.265960 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.266084 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.266297 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:14:05.266389 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.266526 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.266705 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.266872 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267112 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267292 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267440 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267594 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267726 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267853 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.267975 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.268134 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.268311 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269457 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.269904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270086 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270155 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270397 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270490 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270646 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270812 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.270996 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271164 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271330 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.82/identity {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271492 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271651 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.271984 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272150 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272317 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272482 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272648 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272812 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.272976 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.273843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.273843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.273843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.273843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.273843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274168 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274168 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274289 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274363 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274578 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274723 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.274863 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275034 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275174 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275324 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275474 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275615 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275763 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.275903 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.276896 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.277085 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.277245 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.277397 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.277549 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.277794 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.278583 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.278767 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.278971 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.279125 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.279326 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.279523 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.279678 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.279843 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280008 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280174 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280346 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280493 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280662 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280829 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.280993 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281159 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281326 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281490 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281653 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.281984 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.282147 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.282311 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.282473 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.282646 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.282827 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284006 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284175 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284331 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284499 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284664 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284815 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.284969 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.285135 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.285301 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.286391 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.286570 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.286751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.286957 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.287077 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.287817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.287817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.287817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.287817 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.289402 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290314 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290801 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:05.290886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.290886 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.291500 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.291500 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.291500 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.291500 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292434 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292434 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292580 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292659 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292799 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.292965 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293130 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293296 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293461 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293625 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293790 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.82/identity {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.293954 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.294119 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.294283 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.295751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.295751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.295751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.295751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.295751 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296279 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296279 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296279 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296279 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296658 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296658 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296867 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.296867 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297074 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297179 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297309 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297475 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297639 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297803 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.297968 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298220 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298329 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298450 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298615 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298780 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.298976 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.299146 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.299311 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.299477 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.299643 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.299807 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.300005 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.300116 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.300281 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.300446 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.301401 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302017 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302017 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302017 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302017 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302395 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302395 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302659 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302659 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302898 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.302898 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303233 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303338 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303443 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303573 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303738 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.303904 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304069 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304234 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304580 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304746 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.304911 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305076 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305242 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305417 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305581 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305745 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.305909 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306073 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306237 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306412 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306576 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306741 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.306924 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.308609 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.308609 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.308609 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.308609 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.308609 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309203 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309203 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309203 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309505 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309505 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309753 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.309753 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.310075 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.310075 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.310248 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.310332 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.310476 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.311225 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.311395 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.311721 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.312047 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.312372 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.312566 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.312718 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.312883 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313049 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313214 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313394 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313555 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313699 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.313871 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314037 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314203 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314368 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314543 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314717 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.314890 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.315080 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.315316 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.315452 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.315756 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.316053 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317089 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317089 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317089 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317351 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317489 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317666 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.317845 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318009 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318177 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318340 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318562 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318657 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.318824 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.319009 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.319176 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.319341 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.320362 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.320590 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.320797 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.321323 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.321487 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:14:05.321666 dv-cinder-819007-2-iscsi neutron-server[102996]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 16:14:16.924905 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d34da60-c551-483e-8163-b164342f3dec None None] get_active_networks_info from dv-cinder-819007-2-iscsi {{(pid=103143) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 16:14:16.985149 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d34da60-c551-483e-8163-b164342f3dec None None] No non-hosted networks {{(pid=103143) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 24 16:14:16.992741 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.agentschedulers_db [None req-2d34da60-c551-483e-8163-b164342f3dec None None] DHCP Agent not found on host dv-cinder-819007-2-iscsi {{(pid=103143) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 24 16:14:17.052171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-771c4ebf-25a6-4c35-8817-6a3036107a49 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:19.265922 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2c6fe929-a927-491b-91b5-b073d28e4965 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:19.303963 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.db.api [None req-846d66bf-16c8-4fc5-972d-725045db85bb None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-819007-2-iscsi {{(pid=103143) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 16:14:19.304657 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG oslo_db.api [None req-846d66bf-16c8-4fc5-972d-725045db85bb None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 16:14:19.960336 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-846d66bf-16c8-4fc5-972d-725045db85bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:20.312539 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:21.781251 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:22.392185 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:22.393471 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.394042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.394694 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.395289 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:22.401964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-819007-2-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:22.422663 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-819007-2-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:22.851406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43644) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:23.378298 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING oslo_policy.policy [None req-a3bf1350-8118-4909-9902-eda4bac6b6f4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:23.378900 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING oslo_policy.policy [None req-a3bf1350-8118-4909-9902-eda4bac6b6f4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:23.601860 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [None req-a3bf1350-8118-4909-9902-eda4bac6b6f4 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:14:23.614447 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a3bf1350-8118-4909-9902-eda4bac6b6f4 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7504530 Nov 24 16:14:23.804038 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.db.l3_hamode_db [None req-2cefce84-ae21-4c3c-8b20-b9816dcfcdb9 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 24 16:14:23.888870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cefce84-ae21-4c3c-8b20-b9816dcfcdb9 None None] Routers set() bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:23.889715 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cefce84-ae21-4c3c-8b20-b9816dcfcdb9 None None] Router IDs set() for agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 16:14:26.107623 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43660) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:26.409550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] Request body: {'subnetpool': {'shared': True, 'name': 'shared-default-subnetpool-v4', 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:26.508026 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.policy [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103142) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 16:14:26.555349 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING oslo_policy.policy [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:26.556026 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING oslo_policy.policy [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:26.565264 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.quota [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] Loaded quota_driver: . Nov 24 16:14:26.724570 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967879710', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967880227', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967860597', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967861370', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967873343', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8778967847435', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1541274', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1343217', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3893531', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3817719'] for rbac-policy, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:26.930642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:26.931821 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-030241aa-66f5-4329-8b02-fdcafa8c97a4 admin admin] 10.222.0.82 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8232362 Nov 24 16:14:29.617342 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43672) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:29.912217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'name': 'private'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:30.028503 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Made reservation on behalf of 97417fe1ceb84e44ae11e020e0ac67bf for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:30.031996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.048545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.154671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.222391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.241600 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 878} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:14:30.269538 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8778970271919', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.270135 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Unsubscribe: segment precommit_create {{(pid=103142) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 16:14:30.270652 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Added segment b7649b9f-5824-4932-a9a6-7d4965358c2b of type vlan for network 61489224-6fc2-427d-9324-dcb8ece6747c Nov 24 16:14:30.287665 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1bbd541-e255-4397-ae85-15885afca864,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:30.337613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.337979 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.338321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.338656 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.339012 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.339363 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.339957 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.340296 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.340638 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.340963 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.341280 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.341596 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Tracked resource versions report: Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: pushed versions: Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: { 'AddressGroup': {'1.2'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'ConntrackHelper': {'1.0'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Log': {'1.0'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Network': {'1.1'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Port': {'1.7'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'PortForwarding': {'1.2'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'QosPolicy': {'1.10'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroup': {'1.5'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SubPort': {'1.0'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Subnet': {'1.1'}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Trunk': {'1.1'}} Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: consumer versions: Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'ConntrackHelper': '1.0', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Log': '1.0', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Network': '1.1', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Port': '1.7', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'PortForwarding': '1.2', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'QosPolicy': '1.10', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroup': '1.5', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroupRule': '1.2', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SubPort': '1.0', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Subnet': '1.1', Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Trunk': '1.1'}} Nov 24 16:14:30.342731 dv-cinder-819007-2-iscsi neutron-server[103142]: {{(pid=103142) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:14:30.382258 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.491189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.492295 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:30.493017 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:30.595429 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] Pushing event updated for resources: {'Network': ['ID=61489224-6fc2-427d-9324-dcb8ece6747c,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:30.607064 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 61489224-6fc2-427d-9324-dcb8ece6747c details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:14:30.619636 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-0429fd6f-ff83-43a1-bea8-873500b8e897 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.0011871 Nov 24 16:14:33.349510 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43686) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:33.834103 dv-cinder-819007-2-iscsi neutron-server[103141]: WARNING oslo_policy.policy [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:33.834671 dv-cinder-819007-2-iscsi neutron-server[103141]: WARNING oslo_policy.policy [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:34.289062 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.policy [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103141) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 16:14:34.334986 dv-cinder-819007-2-iscsi neutron-server[103141]: WARNING oslo_policy.policy [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:34.335322 dv-cinder-819007-2-iscsi neutron-server[103141]: WARNING oslo_policy.policy [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 16:14:34.345111 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:34.347065 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9c6d774b-5983-4a0a-885b-015e71a50b7e admin admin] 10.222.0.82 "GET /v2.0/networks/61489224-6fc2-427d-9324-dcb8ece6747c HTTP/1.1" status: 200 len: 825 time: 0.9954383 Nov 24 16:14:34.384818 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-da2eaa54-4b59-4bee-9077-2eb86492bac6 admin admin] 10.222.0.82 "GET /v2.0/subnetpools/c8972cbb-cb5e-45ad-bb9c-68348159a95d HTTP/1.1" status: 200 len: 734 time: 0.0316830 Nov 24 16:14:34.394647 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Request body: {'subnet': {'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'ip_version': 4, 'name': 'private-subnet', 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d', 'gateway_ip': '172.20.0.1'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:34.396228 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.quota [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Loaded quota_driver: . Nov 24 16:14:34.480014 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Made reservation on behalf of 97417fe1ceb84e44ae11e020e0ac67bf for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:34.482881 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Publish callbacks [] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:34.812105 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:34.882025 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Checking segment: {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:34.882394 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Network hostable DHCP agents. Network: 61489224-6fc2-427d-9324-dcb8ece6747c, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:14:34.896072 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Pushing event updated for resources: {'Subnet': ['ID=5582495b-d4fb-4dae-98bb-4001de55298b,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:34.910886 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.914991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.914991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.914991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.914991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.914991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Tracked resource versions report: Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: pushed versions: Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: { 'AddressGroup': {'1.2'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'ConntrackHelper': {'1.0'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Log': {'1.0'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Network': {'1.1'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Port': {'1.7'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'PortForwarding': {'1.2'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'QosPolicy': {'1.10'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroup': {'1.5'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SubPort': {'1.0'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Subnet': {'1.1'}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Trunk': {'1.1'}} Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: consumer versions: Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'ConntrackHelper': '1.0', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Log': '1.0', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Network': '1.1', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Port': '1.7', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'PortForwarding': '1.2', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'QosPolicy': '1.10', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroup': '1.5', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroupRule': '1.2', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SubPort': '1.0', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Subnet': '1.1', Nov 24 16:14:34.915710 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Trunk': '1.1'}} Nov 24 16:14:34.917433 dv-cinder-819007-2-iscsi neutron-server[103141]: {{(pid=103141) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:14:34.985380 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Network 61489224-6fc2-427d-9324-dcb8ece6747c is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:14:35.079453 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 61489224-6fc2-427d-9324-dcb8ece6747c) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:35.084080 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:35.084789 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:35.091963 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cb511cd-f38c-45c4-b169-ed6823d28827 None None] Network 61489224-6fc2-427d-9324-dcb8ece6747c requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:35.179447 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-05e93833-b7f8-42b5-a873-1a52e7e718db admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7882006 Nov 24 16:14:35.421897 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-61489224-6fc2-427d-9324-dcb8ece6747c', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:14:35.423182 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:35.719302 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Allocated IP 172.20.0.2 (61489224-6fc2-427d-9324-dcb8ece6747c/5582495b-d4fb-4dae-98bb-4001de55298b/a0830e73-7a52-4139-b9ee-db18dca0b4f0) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:14:35.922698 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:35.992043 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.065128 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Network 61489224-6fc2-427d-9324-dcb8ece6747c is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:14:36.070561 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:36.073508 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:14:36.085497 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Pushing event updated for resources: {'Port': ['ID=a0830e73-7a52-4139-b9ee-db18dca0b4f0,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:36.130472 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.131115 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.131233 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.131527 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.131861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.132193 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.132522 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.132848 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.133191 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.133521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.133859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.134181 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Tracked resource versions report: Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: pushed versions: Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: { 'AddressGroup': {'1.2'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'ConntrackHelper': {'1.0'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Log': {'1.0'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Network': {'1.1'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Port': {'1.7'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'PortForwarding': {'1.2'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'QosPolicy': {'1.10'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroup': {'1.5'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SubPort': {'1.0'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Subnet': {'1.1'}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Trunk': {'1.1'}} Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: consumer versions: Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'ConntrackHelper': '1.0', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Log': '1.0', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Network': '1.1', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Port': '1.7', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'PortForwarding': '1.2', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'QosPolicy': '1.10', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroup': '1.5', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroupRule': '1.2', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SubPort': '1.0', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Subnet': '1.1', Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Trunk': '1.1'}} Nov 24 16:14:36.135299 dv-cinder-819007-2-iscsi neutron-server[103143]: {{(pid=103143) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:14:36.169732 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Attempting to bind port a0830e73-7a52-4139-b9ee-db18dca0b4f0 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:14:36.170683 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Attempting to bind port a0830e73-7a52-4139-b9ee-db18dca0b4f0 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:14:36.171128 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Attempting to bind port a0830e73-7a52-4139-b9ee-db18dca0b4f0 on network 61489224-6fc2-427d-9324-dcb8ece6747c {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:14:36.176009 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 14, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:14:36.176396 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Checking segment: {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:36.176842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.177231 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Bound using segment: {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:14:36.177715 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Bound port: a0830e73-7a52-4139-b9ee-db18dca0b4f0, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:14:36.178142 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.238803 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] For port a0830e73-7a52-4139-b9ee-db18dca0b4f0, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:14:36.259759 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] For port a0830e73-7a52-4139-b9ee-db18dca0b4f0, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a0830e73-7a52-4139-b9ee-db18dca0b4f0,segment=NetworkSegment(b7649b9f-5824-4932-a9a6-7d4965358c2b),segment_id=b7649b9f-5824-4932-a9a6-7d4965358c2b)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:14:36.326249 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:36.386946 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4648e2e1-e047-4aba-84e9-9a430b45282d None None] Pushing event updated for resources: {'Port': ['ID=a0830e73-7a52-4139-b9ee-db18dca0b4f0,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:37.734176 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43706) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:38.058258 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [None req-e7afe144-1dfc-4edb-84bf-db63c117dcce admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:14:38.059275 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e7afe144-1dfc-4edb-84bf-db63c117dcce admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3239725 Nov 24 16:14:40.585655 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43714) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:40.909381 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [None req-2bc51a21-66a5-45e4-b1a7-35abc440d181 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:14:40.911919 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2bc51a21-66a5-45e4-b1a7-35abc440d181 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3239241 Nov 24 16:14:43.644506 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43724) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:43.942769 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'name': 'router1'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:44.039868 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.041508 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.185026 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.251947 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.332863 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:44.334082 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-601a5764-070c-4b01-a3d0-9a74654f6ec0 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6885133 Nov 24 16:14:45.429645 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05297a47-e29e-4570-969a-4d2cd297e62a None None] Network 61489224-6fc2-427d-9324-dcb8ece6747c requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:45.551205 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] Provisioning complete for port a0830e73-7a52-4139-b9ee-db18dca0b4f0 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:45.551588 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.738661 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.778119 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] For port a0830e73-7a52-4139-b9ee-db18dca0b4f0, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a0830e73-7a52-4139-b9ee-db18dca0b4f0,segment=NetworkSegment(b7649b9f-5824-4932-a9a6-7d4965358c2b),segment_id=b7649b9f-5824-4932-a9a6-7d4965358c2b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:45.842879 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:45.894745 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf17db7-2dcd-4cb8-b4ed-4c6f393b4cdc None None] Pushing event updated for resources: {'Port': ['ID=a0830e73-7a52-4139-b9ee-db18dca0b4f0,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:45.964054 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-05c4e568-52a3-4ae8-ae18-af50f7fccfde None None] Provisioning complete for port a0830e73-7a52-4139-b9ee-db18dca0b4f0 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:45.964681 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-05c4e568-52a3-4ae8-ae18-af50f7fccfde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.144026 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a0830e73-7a52-4139-b9ee-db18dca0b4f0 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:14:46.192423 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port a0830e73-7a52-4139-b9ee-db18dca0b4f0 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:46.192800 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:46.820278 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43736) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:46.902288 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ded2aca5-feae-4b4b-a2ee-444089e7614b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:47.129466 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [None req-34995507-6f7c-41ea-a058-19ffad512592 admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:14:47.130457 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-34995507-6f7c-41ea-a058-19ffad512592 admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3092360 Nov 24 16:14:49.248413 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d8371337-775f-495c-b528-bdc4e557f4f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:49.607840 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43744) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:49.918175 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'name': 'public', 'is_default': True}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:50.045285 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Made reservation on behalf of 6d45d27450d34bac9b272694b2e9d755 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:50.047511 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.055622 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.126557 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.173900 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:14:50.205163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.220078 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Reserving flat network on physical network physnet1 {{(pid=103142) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 24 16:14:50.241300 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e9e4f45-1d8f-46c1-80b3-bcf6cba47539,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:50.244332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.244683 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Added segment 890dc0fb-5bd2-483a-82f2-fe5aa7d3675c of type flat for network 03b2fe8c-76ac-4bca-971e-09f45230a994 Nov 24 16:14:50.291024 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.296918 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.382539 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.383530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:50.384124 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:50.459405 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] Pushing event updated for resources: {'Network': ['ID=03b2fe8c-76ac-4bca-971e-09f45230a994,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:50.470327 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:14:50.488199 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bb95c77f-f282-4bb3-b088-aac76e6a94f2 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8792717 Nov 24 16:14:51.648124 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:52.402438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:53.000049 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43762) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:53.172238 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00c9384a-e015-4da9-8151-9b8d9082aae1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:53.173545 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-00c9384a-e015-4da9-8151-9b8d9082aae1 admin admin] 10.222.0.82 "GET /v2.0/subnets/5582495b-d4fb-4dae-98bb-4001de55298b HTTP/1.1" status: 200 len: 849 time: 0.1725135 Nov 24 16:14:53.353905 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-5e689e1e-c894-4c23-87ae-0e9c14ec4e82 admin admin] 10.222.0.82 "GET /v2.0/routers/d8784af4-f9fe-424c-a133-c9f5dc31378b HTTP/1.1" status: 200 len: 704 time: 0.1743338 Nov 24 16:14:53.614188 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:53.908307 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Allocated IP 172.20.0.1 (61489224-6fc2-427d-9324-dcb8ece6747c/5582495b-d4fb-4dae-98bb-4001de55298b/56fee5e4-e552-4325-864d-61880b9ea176) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:14:54.059744 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.220537 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.289202 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Network 61489224-6fc2-427d-9324-dcb8ece6747c is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:14:54.300576 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:54.306262 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:14:54.306552 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.363981 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Pushing event updated for resources: {'Port': ['ID=56fee5e4-e552-4325-864d-61880b9ea176,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:54.511978 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-9d2c3bb4-8f0a-42f6-aca1-3cd14f22d197 None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:54.512551 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9d2c3bb4-8f0a-42f6-aca1-3cd14f22d197 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.549740 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-9d2c3bb4-8f0a-42f6-aca1-3cd14f22d197 None None] Port 56fee5e4-e552-4325-864d-61880b9ea176 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:14:54.583646 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.852990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.927786 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.928584 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:54.987319 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Pushing event updated for resources: {'Port': ['ID=56fee5e4-e552-4325-864d-61880b9ea176,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:55.060274 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Network 61489224-6fc2-427d-9324-dcb8ece6747c is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:14:55.061635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:55.275748 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-f95863fc-74c9-40d3-956e-399095d5a95b None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:55.276120 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f95863fc-74c9-40d3-956e-399095d5a95b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:55.302570 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Router d8784af4-f9fe-424c-a133-c9f5dc31378b is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:14:55.355031 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-f95863fc-74c9-40d3-956e-399095d5a95b None None] Port 56fee5e4-e552-4325-864d-61880b9ea176 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:14:55.400122 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:14:55.405343 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-f3a75fa4-73a9-4e8e-a4c3-741c2e6135b1 admin admin] 10.222.0.82 "PUT /v2.0/routers/d8784af4-f9fe-424c-a133-c9f5dc31378b/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0474470 Nov 24 16:14:55.417946 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Sync routers for ids ['d8784af4-f9fe-424c-a133-c9f5dc31378b'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:14:55.430667 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Routers {'d8784af4-f9fe-424c-a133-c9f5dc31378b'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:55.431534 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:14:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['d8784af4-f9fe-424c-a133-c9f5dc31378b'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:55.624215 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Set router d8784af4-f9fe-424c-a133-c9f5dc31378b gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:56.060866 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:14:54Z', 'revision_number': 2, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port_host': None, '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:54Z', 'revision_number': 2, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:56.112364 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Checking router: d8784af4-f9fe-424c-a133-c9f5dc31378b for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:14:56.112743 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Updating router d8784af4-f9fe-424c-a133-c9f5dc31378b port 56fee5e4-e552-4325-864d-61880b9ea176 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:14:56.160666 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.679508 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.768582 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.934302 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Pushing event updated for resources: {'Port': ['ID=56fee5e4-e552-4325-864d-61880b9ea176,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:56.950211 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.951129 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.951477 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.951816 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.952154 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.952485 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.952821 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.953146 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.953477 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.953800 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.954119 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.954438 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Tracked resource versions report: Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: pushed versions: Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: { 'AddressGroup': {'1.2'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'ConntrackHelper': {'1.0'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Log': {'1.0'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Network': {'1.1'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Port': {'1.7'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'PortForwarding': {'1.2'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'QosPolicy': {'1.10'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroup': {'1.5'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SubPort': {'1.0'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Subnet': {'1.1'}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Trunk': {'1.1'}} Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: consumer versions: Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'ConntrackHelper': '1.0', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Log': '1.0', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Network': '1.1', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Port': '1.7', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'PortForwarding': '1.2', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'QosPolicy': '1.10', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroup': '1.5', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroupRule': '1.2', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SubPort': '1.0', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Subnet': '1.1', Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Trunk': '1.1'}} Nov 24 16:14:56.955544 dv-cinder-819007-2-iscsi neutron-server[103144]: {{(pid=103144) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:14:56.960098 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Attempting to bind port 56fee5e4-e552-4325-864d-61880b9ea176 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:14:56.960498 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Attempting to bind port 56fee5e4-e552-4325-864d-61880b9ea176 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:14:56.960952 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Attempting to bind port 56fee5e4-e552-4325-864d-61880b9ea176 on network 61489224-6fc2-427d-9324-dcb8ece6747c {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:14:56.967139 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 14, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:14:56.967556 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Checking segment: {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:56.968013 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.969207 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Bound using segment: {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:14:56.970047 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Bound port: 56fee5e4-e552-4325-864d-61880b9ea176, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7649b9f-5824-4932-a9a6-7d4965358c2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:14:56.970459 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:56.981554 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-53278e41-593c-4e1e-8d30-0a42673e86d8 None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:56.982061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-53278e41-593c-4e1e-8d30-0a42673e86d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.015644 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-53278e41-593c-4e1e-8d30-0a42673e86d8 None None] Port 56fee5e4-e552-4325-864d-61880b9ea176 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:14:57.040767 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] For port 56fee5e4-e552-4325-864d-61880b9ea176, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:14:57.060285 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] For port 56fee5e4-e552-4325-864d-61880b9ea176, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=56fee5e4-e552-4325-864d-61880b9ea176,segment=NetworkSegment(b7649b9f-5824-4932-a9a6-7d4965358c2b),segment_id=b7649b9f-5824-4932-a9a6-7d4965358c2b)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:14:57.142825 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.189623 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Routers {'d8784af4-f9fe-424c-a133-c9f5dc31378b'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:14:57.190240 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:14:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['d8784af4-f9fe-424c-a133-c9f5dc31378b'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:57.266844 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e4517f-5e23-4893-9049-455d3799d23e None None] Pushing event updated for resources: {'Port': ['ID=56fee5e4-e552-4325-864d-61880b9ea176,revision_number=4']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:57.292537 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] Set router d8784af4-f9fe-424c-a133-c9f5dc31378b gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:14:57.337518 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-80801f89-5015-466f-876e-45114562c47c None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:14:57.337897 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-80801f89-5015-466f-876e-45114562c47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.424462 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-80801f89-5015-466f-876e-45114562c47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.456609 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-80801f89-5015-466f-876e-45114562c47c None None] For port 56fee5e4-e552-4325-864d-61880b9ea176, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=56fee5e4-e552-4325-864d-61880b9ea176,segment=NetworkSegment(b7649b9f-5824-4932-a9a6-7d4965358c2b),segment_id=b7649b9f-5824-4932-a9a6-7d4965358c2b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:14:57.519847 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-80801f89-5015-466f-876e-45114562c47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:57.527782 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:14:54Z', 'revision_number': 2, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port_host': None, '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:57Z', 'revision_number': 4, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:14:57.555960 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9b2f4b7-898b-4094-9d6a-e16932a0c239 None None] The sync data for ids ['d8784af4-f9fe-424c-a133-c9f5dc31378b'] in dv-cinder-819007-2-iscsi is: [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:14:54Z', 'revision_number': 2, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port_host': None, '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:57Z', 'revision_number': 4, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:14:57.572324 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80801f89-5015-466f-876e-45114562c47c None None] Pushing event updated for resources: {'Port': ['ID=56fee5e4-e552-4325-864d-61880b9ea176,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:57.772121 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43782) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:14:57.883588 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62f83bee-727d-40cf-94d4-c2ac8ad21ef2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:57.885043 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-62f83bee-727d-40cf-94d4-c2ac8ad21ef2 admin admin] 10.222.0.82 "GET /v2.0/networks/03b2fe8c-76ac-4bca-971e-09f45230a994 HTTP/1.1" status: 200 len: 842 time: 0.1117177 Nov 24 16:14:57.895361 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'ip_version': 4, 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'name': 'public-subnet'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:14:58.010683 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Made reservation on behalf of 6d45d27450d34bac9b272694b2e9d755 for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:14:58.013721 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.357751 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.objects.ports [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103141) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 16:14:58.358204 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.416974 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Pushing event updated for resources: {'Subnet': ['ID=15e78730-137b-4455-919a-a8f2c37bf26d,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:14:58.424393 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:14:58.424752 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Network hostable DHCP agents. Network: 03b2fe8c-76ac-4bca-971e-09f45230a994, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:14:58.519579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:14:58.587733 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 03b2fe8c-76ac-4bca-971e-09f45230a994) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:14:58.593410 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:14:58.594129 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:14:58.598045 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9521b5d-1daa-43ef-a8e0-1d38c2fb52dc None None] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:14:58.697913 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-3db0209f-ca4c-4bda-97ff-acffd6ea5489 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7971768 Nov 24 16:14:58.746005 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-930773bd-2de8-4d06-9f7a-f6e6e264de09 None None] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:15:01.111410 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 43790) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:01.241063 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a624520d-3b5a-4b3c-932a-e5b97a687d70 admin admin] 10.222.0.82 "GET /v2.0/routers/d8784af4-f9fe-424c-a133-c9f5dc31378b HTTP/1.1" status: 200 len: 710 time: 0.1285274 Nov 24 16:15:01.332647 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c5c08f4-8b6f-4aaa-8bca-c0e931c96fb8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:15:01.333971 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-3c5c08f4-8b6f-4aaa-8bca-c0e931c96fb8 admin admin] 10.222.0.82 "GET /v2.0/networks/03b2fe8c-76ac-4bca-971e-09f45230a994 HTTP/1.1" status: 200 len: 886 time: 0.0871394 Nov 24 16:15:01.344371 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:15:01.656799 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:01.956311 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.030973 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.139065 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Allocated IP 172.27.2.137 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/a611e180-d438-4e55-9c58-d68b5aa7977d) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:15:02.238457 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.336693 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.373000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:15:02.378233 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:15:02.382264 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:15:02.417466 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Pushing event updated for resources: {'Port': ['ID=a611e180-d438-4e55-9c58-d68b5aa7977d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:02.693341 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.898633 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3810116', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3810664', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13980'] for router, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:02.902058 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3810125', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3810134', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3810655'] for router, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:03.014137 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Router d8784af4-f9fe-424c-a133-c9f5dc31378b has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:15:03.125123 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:15:03.129612 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:03.130823 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-91b75a37-5d3d-4975-81bb-08e73d1450ae admin admin] 10.222.0.82 "PUT /v2.0/routers/d8784af4-f9fe-424c-a133-c9f5dc31378b HTTP/1.1" status: 200 len: 890 time: 1.7904210 Nov 24 16:15:04.165446 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 56fee5e4-e552-4325-864d-61880b9ea176 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:15:04.219612 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:15:04.219996 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:04.487497 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Sync routers for ids ['d8784af4-f9fe-424c-a133-c9f5dc31378b'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:15:04.499696 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Routers {'d8784af4-f9fe-424c-a133-c9f5dc31378b'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:04.500427 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:14:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['d8784af4-f9fe-424c-a133-c9f5dc31378b'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:04.707095 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Set router d8784af4-f9fe-424c-a133-c9f5dc31378b gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:05.109864 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137'}], 'enable_snat': True}, 'gw_port_id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:15:02Z', 'revision_number': 4, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port': {'id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:f6:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:15:02Z', 'updated_at': '2021-11-24T16:15:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:57Z', 'revision_number': 5, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:05.233827 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Checking router: d8784af4-f9fe-424c-a133-c9f5dc31378b for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:15:05.234496 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Updating router d8784af4-f9fe-424c-a133-c9f5dc31378b port a611e180-d438-4e55-9c58-d68b5aa7977d binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:15:05.281155 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.604096 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.645116 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 43802) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:15:05.665221 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.717199 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Attempting to bind port a611e180-d438-4e55-9c58-d68b5aa7977d on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:15:05.717580 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Attempting to bind port a611e180-d438-4e55-9c58-d68b5aa7977d by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:15:05.717950 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Attempting to bind port a611e180-d438-4e55-9c58-d68b5aa7977d on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:15:05.720736 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a6db51-617e-4f19-9867-4387ef43fb2b None None] Pushing event updated for resources: {'Port': ['ID=a611e180-d438-4e55-9c58-d68b5aa7977d,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:05.725191 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 14, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:15:05.725576 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:15:05.725978 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.726367 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:15:05.726842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Bound port: a611e180-d438-4e55-9c58-d68b5aa7977d, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:15:05.727849 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.772075 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-84821da0-a878-4a9f-8740-6eecb4fbe722 admin admin] 10.222.0.82 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1257918 Nov 24 16:15:05.776802 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] For port a611e180-d438-4e55-9c58-d68b5aa7977d, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:15:05.780120 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] For port a611e180-d438-4e55-9c58-d68b5aa7977d, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a611e180-d438-4e55-9c58-d68b5aa7977d,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:15:05.860029 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:05.926084 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Routers {'d8784af4-f9fe-424c-a133-c9f5dc31378b'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:15:05.926742 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:14:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['d8784af4-f9fe-424c-a133-c9f5dc31378b'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:05.928845 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a6db51-617e-4f19-9867-4387ef43fb2b None None] Pushing event updated for resources: {'Port': ['ID=a611e180-d438-4e55-9c58-d68b5aa7977d,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:06.041087 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] Set router d8784af4-f9fe-424c-a133-c9f5dc31378b gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:15:06.261629 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137'}], 'enable_snat': True}, 'gw_port_id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:15:02Z', 'revision_number': 4, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port': {'id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:f6:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:15:02Z', 'updated_at': '2021-11-24T16:15:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:57Z', 'revision_number': 5, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:15:06.292050 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bc63485-71c7-4dcf-b564-66855c9d47b5 None None] The sync data for ids ['d8784af4-f9fe-424c-a133-c9f5dc31378b'] in dv-cinder-819007-2-iscsi is: [{'id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'name': 'router1', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137'}], 'enable_snat': True}, 'gw_port_id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:14:44Z', 'updated_at': '2021-11-24T16:15:02Z', 'revision_number': 4, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'gw_port': {'id': 'a611e180-d438-4e55-9c58-d68b5aa7977d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:f6:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:15:02Z', 'updated_at': '2021-11-24T16:15:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '56fee5e4-e552-4325-864d-61880b9ea176', 'name': '', 'network_id': '61489224-6fc2-427d-9324-dcb8ece6747c', 'tenant_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'mac_address': 'fa:16:3e:0b:cb:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd8784af4-f9fe-424c-a133-c9f5dc31378b', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:14:53Z', 'updated_at': '2021-11-24T16:14:57Z', 'revision_number': 5, 'project_id': '97417fe1ceb84e44ae11e020e0ac67bf', 'subnets': [{'id': '5582495b-d4fb-4dae-98bb-4001de55298b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'c8972cbb-cb5e-45ad-bb9c-68348159a95d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:15:08.191859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a611e180-d438-4e55-9c58-d68b5aa7977d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:15:08.243220 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port a611e180-d438-4e55-9c58-d68b5aa7977d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:15:08.243720 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:08.326358 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:08.347259 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port a611e180-d438-4e55-9c58-d68b5aa7977d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a611e180-d438-4e55-9c58-d68b5aa7977d,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:15:08.420097 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:08.491696 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=a611e180-d438-4e55-9c58-d68b5aa7977d,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:15:10.203129 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a611e180-d438-4e55-9c58-d68b5aa7977d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:15:10.261208 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port a611e180-d438-4e55-9c58-d68b5aa7977d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:15:10.261873 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:16.952158 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-381eb0be-5094-4d02-a6de-c9b5e6ebda22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:19.224693 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4d92be49-b6a9-480b-8e0e-d0af1f41572c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:20.279336 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:21.636907 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:22.391276 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:27.173844 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:15:46.964216 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c23c3e77-f2cd-4248-90a8-16151a70b389 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:49.227305 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-41f47313-3401-4572-9363-da6bc84bda14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:50.279489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.399678 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:15:52.420673 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:04.173530 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:16:16.920686 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-95f6b9d6-84a9-407c-b9f6-cfde3b2ef784 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:19.257878 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f06e3b55-9064-40e1-ae1e-446639af19f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:20.282853 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:21.649378 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:22.391605 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:27.055292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44286) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:27.121616 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.pecan_wsgi.hooks.translation [None req-35588e7c-5571-44c2-b8dc-8f06c4272858 admin admin] GET failed (client error): The resource could not be found. Nov 24 16:16:27.122896 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-35588e7c-5571-44c2-b8dc-8f06c4272858 admin admin] 10.222.0.82 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0666506 Nov 24 16:16:27.284804 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db281995-5ec6-401d-b6ad-0cb023c6710a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:27.286196 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-db281995-5ec6-401d-b6ad-0cb023c6710a admin admin] 10.222.0.82 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1587043 Nov 24 16:16:29.594950 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44296) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:29.723592 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6e0bb4c-0542-4e0e-8e75-2e78f3df1153 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:29.724996 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b6e0bb4c-0542-4e0e-8e75-2e78f3df1153 admin admin] 10.222.0.82 "GET /v2.0/subnets/5582495b-d4fb-4dae-98bb-4001de55298b HTTP/1.1" status: 200 len: 849 time: 0.1290905 Nov 24 16:16:29.734780 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:16:29.819009 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Publish callbacks [] for subnet, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:30.126562 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8778970144377'] for subnet, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:30.167883 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:30.168507 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:30.169797 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] 10.222.0.82 "PUT /v2.0/subnets/5582495b-d4fb-4dae-98bb-4001de55298b HTTP/1.1" status: 200 len: 868 time: 0.4386201 Nov 24 16:16:30.171282 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a35fc4b8-93d6-4d26-a262-48a3cd3f5710 None None] Network 61489224-6fc2-427d-9324-dcb8ece6747c requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:16:30.182625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Pushing event updated for resources: {'Subnet': ['ID=5582495b-d4fb-4dae-98bb-4001de55298b,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:16:30.192677 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.193373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.193888 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.194226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.194613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.195009 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.195356 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.195696 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.196029 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.196353 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.197951 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.197951 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614b1a47-1704-4dfa-a5e2-836a173e47dc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:16:30.575834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-96729095-fbb0-4432-b577-df5e5a0ca7ec None None] Provisioning complete for port a0830e73-7a52-4139-b9ee-db18dca0b4f0 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:30.576220 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-96729095-fbb0-4432-b577-df5e5a0ca7ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:30.662954 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-96729095-fbb0-4432-b577-df5e5a0ca7ec None None] Provisioning complete for port 56fee5e4-e552-4325-864d-61880b9ea176 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:16:30.663209 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-96729095-fbb0-4432-b577-df5e5a0ca7ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:32.506271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44304) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:32.709523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c82a550-7d2c-4edf-9e15-6991e67b9389 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:32.709900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c82a550-7d2c-4edf-9e15-6991e67b9389 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:32.711460 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7c82a550-7d2c-4edf-9e15-6991e67b9389 admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2042265 Nov 24 16:16:34.980918 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44312) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:35.247214 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8541d73e-6100-4f66-8f68-2bb9e55cf27b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:35.247690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8541d73e-6100-4f66-8f68-2bb9e55cf27b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:35.249244 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8541d73e-6100-4f66-8f68-2bb9e55cf27b admin admin] 10.222.0.82 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2673836 Nov 24 16:16:37.530117 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44322) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:37.655120 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24787218-9281-4694-a779-d0f5b4072a63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:37.656483 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-24787218-9281-4694-a779-d0f5b4072a63 admin admin] 10.222.0.82 "GET /v2.0/networks/03b2fe8c-76ac-4bca-971e-09f45230a994 HTTP/1.1" status: 200 len: 886 time: 0.1253812 Nov 24 16:16:40.008202 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44330) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:40.211463 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-434a15df-30d7-4f97-9aef-a6e12a872738 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:40.213629 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-434a15df-30d7-4f97-9aef-a6e12a872738 admin admin] 10.222.0.82 "GET /v2.0/networks/61489224-6fc2-427d-9324-dcb8ece6747c HTTP/1.1" status: 200 len: 869 time: 0.2044740 Nov 24 16:16:41.172296 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:16:42.471878 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44338) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:42.594862 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-479c8ce4-6f97-465d-993b-0235d685f6bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:42.595343 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-479c8ce4-6f97-465d-993b-0235d685f6bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:42.596833 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-479c8ce4-6f97-465d-993b-0235d685f6bc admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1240070 Nov 24 16:16:44.873057 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44346) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:44.996273 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a6e85a5-55a4-47bc-8f97-41764273f7d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:44.996724 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a6e85a5-55a4-47bc-8f97-41764273f7d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:44.998258 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-6a6e85a5-55a4-47bc-8f97-41764273f7d5 admin admin] 10.222.0.82 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1242478 Nov 24 16:16:46.888165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60f5c39f-9a22-416a-a162-17e12da37c52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:47.310213 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44354) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:47.393877 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a84506b5-f3cb-4cec-ad91-4f81f609eab7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:47.395200 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a84506b5-f3cb-4cec-ad91-4f81f609eab7 admin admin] 10.222.0.82 "GET /v2.0/subnets/15e78730-137b-4455-919a-a8f2c37bf26d HTTP/1.1" status: 200 len: 816 time: 0.0840189 Nov 24 16:16:49.225528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6f6c5e5f-be99-4539-aba0-218399dfccb6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:49.670917 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44362) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:16:49.761129 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2eab11af-d3bf-4d24-84e2-445b2615477b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:16:49.762449 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2eab11af-d3bf-4d24-84e2-445b2615477b admin admin] 10.222.0.82 "GET /v2.0/subnets/5582495b-d4fb-4dae-98bb-4001de55298b HTTP/1.1" status: 200 len: 868 time: 0.0905309 Nov 24 16:16:50.293477 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:51.648226 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:16:52.390640 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:14.277535 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44416) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:17:14.331401 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [None req-646ccc78-86a7-4a43-a08c-78491101eafa admin admin] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:17:14.332415 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-646ccc78-86a7-4a43-a08c-78491101eafa admin admin] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0539351 Nov 24 16:17:16.726694 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44424) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:17:16.786139 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.pecan_wsgi.hooks.translation [None req-61dd85c2-1758-41e3-a89a-c9acdd025f98 admin admin] GET failed (client error): The resource could not be found. Nov 24 16:17:16.787423 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-61dd85c2-1758-41e3-a89a-c9acdd025f98 admin admin] 10.222.0.82 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0597491 Nov 24 16:17:16.887532 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-67edbcc3-99ce-4182-bf6f-d9275a462727 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:16.933627 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22725fde-33a1-41a4-9054-07fa663bd7b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:16.935051 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-22725fde-33a1-41a4-9054-07fa663bd7b1 admin admin] 10.222.0.82 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1430883 Nov 24 16:17:18.171713 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:17:19.230256 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b572e6f3-16bd-45e9-814f-e22e487a0715 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.259918 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44432) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:17:19.306514 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:17:19.411266 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Made reservation on behalf of 6d45d27450d34bac9b272694b2e9d755 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:17:19.413472 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.447941 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING neutron.services.revisions.revision_plugin [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Could not find related network for resource to bump revision. Nov 24 16:17:19.458181 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 867} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:17:19.466532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.466860 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Added segment 5dbcf00b-55c9-460c-99de-d8b326c48163 of type vlan for network 17fdd946-070b-480a-a561-ab90afd11264 Nov 24 16:17:19.506658 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.593780 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.594698 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:19.595324 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:19.653913 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] Pushing event updated for resources: {'Network': ['ID=17fdd946-070b-480a-a561-ab90afd11264,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:19.663857 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 17fdd946-070b-480a-a561-ab90afd11264 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:17:19.705474 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-41a0d1ca-07d9-4c7a-8b1b-ce93175f5ff0 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4444349 Nov 24 16:17:20.316098 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:21.648104 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:21.980207 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44440) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:17:22.039596 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.pecan_wsgi.hooks.translation [None req-11838c02-9445-4a47-a60a-6d9d99b16b02 admin admin] GET failed (client error): The resource could not be found. Nov 24 16:17:22.041427 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-11838c02-9445-4a47-a60a-6d9d99b16b02 admin admin] 10.222.0.82 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0597305 Nov 24 16:17:22.113256 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc2209a7-6dbb-425d-aa36-1f6c19c5969b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:22.114700 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-cc2209a7-6dbb-425d-aa36-1f6c19c5969b admin admin] 10.222.0.82 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0688446 Nov 24 16:17:22.124716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'network_id': '17fdd946-070b-480a-a561-ab90afd11264', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:17:22.245495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Made reservation on behalf of 6d45d27450d34bac9b272694b2e9d755 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:17:22.247826 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Publish callbacks [] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:22.385023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:22.481522 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:22.540569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Pushing event updated for resources: {'Subnet': ['ID=c8138b94-2584-4be5-8397-7f3201869580,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:22.547064 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Checking segment: {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:17:22.547425 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Network hostable DHCP agents. Network: 17fdd946-070b-480a-a561-ab90afd11264, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:17:22.636219 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Network 17fdd946-070b-480a-a561-ab90afd11264 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:17:22.715513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 17fdd946-070b-480a-a561-ab90afd11264) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:17:22.719560 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:17:22.720160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:22.725876 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d64a3366-eeba-4c83-84ce-104c4e6ec7c0 None None] Network 17fdd946-070b-480a-a561-ab90afd11264 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:17:22.804391 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-517ac0e9-1c7c-4d3f-bf84-6dd0d5f1f3eb admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6828575 Nov 24 16:17:22.970346 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba860951-d242-477f-9b08-46002b83298f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-17fdd946-070b-480a-a561-ab90afd11264', 'network_id': '17fdd946-070b-480a-a561-ab90afd11264', 'tenant_id': '6d45d27450d34bac9b272694b2e9d755', 'fixed_ips': [{'subnet_id': 'c8138b94-2584-4be5-8397-7f3201869580'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:17:22.971275 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.106558 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-ba860951-d242-477f-9b08-46002b83298f None None] Allocated IP 192.168.233.2 (17fdd946-070b-480a-a561-ab90afd11264/c8138b94-2584-4be5-8397-7f3201869580/044c0844-8a0a-4930-93a7-411330d213c8) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:17:23.248891 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.339294 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.378655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba860951-d242-477f-9b08-46002b83298f None None] Network 17fdd946-070b-480a-a561-ab90afd11264 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:17:23.383674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-ba860951-d242-477f-9b08-46002b83298f None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:17:23.387384 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba860951-d242-477f-9b08-46002b83298f None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:17:23.396179 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba860951-d242-477f-9b08-46002b83298f None None] Pushing event updated for resources: {'Port': ['ID=044c0844-8a0a-4930-93a7-411330d213c8,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:23.417397 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.417775 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.418126 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.418467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.418804 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.419162 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.419494 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.419829 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.420169 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.420502 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.420831 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.421152 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:17:23.456331 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ba860951-d242-477f-9b08-46002b83298f None None] Attempting to bind port 044c0844-8a0a-4930-93a7-411330d213c8 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:17:23.456703 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ba860951-d242-477f-9b08-46002b83298f None None] Attempting to bind port 044c0844-8a0a-4930-93a7-411330d213c8 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:17:23.457067 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba860951-d242-477f-9b08-46002b83298f None None] Attempting to bind port 044c0844-8a0a-4930-93a7-411330d213c8 on network 17fdd946-070b-480a-a561-ab90afd11264 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:17:23.462385 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba860951-d242-477f-9b08-46002b83298f None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 17, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:17:23.462761 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba860951-d242-477f-9b08-46002b83298f None None] Checking segment: {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:17:23.463194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.463588 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba860951-d242-477f-9b08-46002b83298f None None] Bound using segment: {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:17:23.464058 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ba860951-d242-477f-9b08-46002b83298f None None] Bound port: 044c0844-8a0a-4930-93a7-411330d213c8, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:17:23.464461 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.529448 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ba860951-d242-477f-9b08-46002b83298f None None] For port 044c0844-8a0a-4930-93a7-411330d213c8, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:17:23.532506 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ba860951-d242-477f-9b08-46002b83298f None None] For port 044c0844-8a0a-4930-93a7-411330d213c8, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=044c0844-8a0a-4930-93a7-411330d213c8,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:17:23.589461 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba860951-d242-477f-9b08-46002b83298f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:23.651246 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba860951-d242-477f-9b08-46002b83298f None None] Pushing event updated for resources: {'Port': ['ID=044c0844-8a0a-4930-93a7-411330d213c8,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:24.288674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 044c0844-8a0a-4930-93a7-411330d213c8 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:17:24.351651 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 044c0844-8a0a-4930-93a7-411330d213c8 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:17:24.352032 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.443201 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.481300 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 044c0844-8a0a-4930-93a7-411330d213c8, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=044c0844-8a0a-4930-93a7-411330d213c8,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:17:24.513104 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4747221-a94a-4954-9062-5ad7b8a81907 None None] Network 17fdd946-070b-480a-a561-ab90afd11264 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:17:24.587835 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.655631 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-17c74e1a-fe31-4ef3-8374-b56759542836 None None] Provisioning complete for port 044c0844-8a0a-4930-93a7-411330d213c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:17:24.656003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-17c74e1a-fe31-4ef3-8374-b56759542836 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:24.711329 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=044c0844-8a0a-4930-93a7-411330d213c8,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:17:25.030127 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-0d421db4-2d54-47cd-b458-5347fd273e04 None None] Provisioning complete for port 044c0844-8a0a-4930-93a7-411330d213c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:17:25.030502 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0d421db4-2d54-47cd-b458-5347fd273e04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:26.252298 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 044c0844-8a0a-4930-93a7-411330d213c8 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:17:26.302538 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 044c0844-8a0a-4930-93a7-411330d213c8 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:17:26.302928 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:46.892670 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f5964ede-c639-41bc-856c-34f5eca2c816 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:49.246723 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-571c3ea5-59cc-4a93-89bc-8cc3d010b00c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:50.326715 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:51.669812 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:52.387801 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:17:55.170001 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:18:16.896943 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a574d657-5f69-4bc1-a264-f2f1bc52c992 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:19.234071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e2fdfd21-9fe0-4084-9964-36fc282cf423 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:20.290037 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:21.674510 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:22.383699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:32.169060 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:18:46.896480 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9bb323fd-6fe3-49cc-9454-a605f6dd85f5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:49.222747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-be2e8de3-69e1-444c-bd10-ffac8de077e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:50.297069 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:51.668313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.405255 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:52.952855 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44486) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:52.959124 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [None req-9115a900-82dc-4367-9b74-b3e519e31f4c tempest-verify_tempest_config-1651848156 tempest-verify_tempest_config-1651848156-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:18:52.960134 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9115a900-82dc-4367-9b74-b3e519e31f4c tempest-verify_tempest_config-1651848156 tempest-verify_tempest_config-1651848156-project] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0062933 Nov 24 16:18:53.442531 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44504) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:53.546228 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.643896 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.723773 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.769291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d648ee5-a54f-4d3c-abeb-a174eee1fc9e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:53.773603 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c618fbeec838420c941e9e22b28155d0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3300593 Nov 24 16:18:53.776406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44510) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:18:53.777814 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.778185 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.778535 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.778875 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.779238 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.779590 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.779928 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.780276 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.780613 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.780939 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.781264 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.781588 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fff0460-a5d9-4c01-98d7-4964411b5309 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.832463 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.853023 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.976780 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.980038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:18:53.981207 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1d648ee5-a54f-4d3c-abeb-a174eee1fc9e HTTP/1.1" status: 204 len: 168 time: 0.2038543 Nov 24 16:18:53.989182 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d648ee5-a54f-4d3c-abeb-a174eee1fc9e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:18:53.995917 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.996305 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.996657 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.997002 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.997340 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.997682 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.998023 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.998403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.998786 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.999148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.999541 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:18:53.999809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b13630c-736e-4300-b937-b8488208af8d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:19:09.168845 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:19:16.900452 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f194954a-ba68-464e-b583-49d8977265d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:19.238575 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e283fdca-d0e1-4ff7-8752-c9b018577144 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:20.300235 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:21.669479 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:22.427605 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:46.167992 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:19:46.895002 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93ef7547-9dde-4fa7-ae2b-f7d0527ca97a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:49.243767 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-585ad589-08a2-41c4-9a14-6b9c09de4c60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:50.312194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:51.666582 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:19:52.466804 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:16.894677 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-56592e0d-b4bf-4ba1-83bc-51fe674fe1c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:19.214859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2a60a156-8260-4326-9d1b-1bf4adafc4c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:20.305894 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:21.666136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:22.397129 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:23.167061 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 5 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:20:28.654103 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-3810390'] for agent, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:43.277724 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44582) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:20:43.381407 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-31d64b45-1080-46dd-a088-6c7607d2147d admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1019607 Nov 24 16:20:45.673305 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44592) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:20:45.726860 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3759e841-5eee-4571-b958-f801e3b8b428 admin admin] 10.222.0.82 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0524740 Nov 24 16:20:46.893882 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba18a5a5-6900-4c16-b0e7-8efd2960ace4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:49.254194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-652c1b13-b05e-4d5d-b429-dd6f75967ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:50.350419 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:51.676467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:52.402494 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:20:58.602217 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:00.167202 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:21:16.898853 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f6d220a5-5267-401f-8ec1-59020d7ba0c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:19.218729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d56f527f-f194-4f13-bc31-4b69fc947425 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:20.299194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:21.670281 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:22.402549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:28.629978 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:37.166745 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:21:46.909619 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e028cf29-9d2a-4097-adbc-0c1a3d8e5865 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:49.229939 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-84d89d7e-4b30-4d12-a208-e98bf25bf4ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:50.332522 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:51.674941 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:52.412461 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:21:58.646426 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:14.165518 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:22:16.015452 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44788) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:16.564653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-network', 'tenant_id': '4ba85d6984964122836595e2e4cf8472'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:16.658978 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Made reservation on behalf of 4ba85d6984964122836595e2e4cf8472 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:16.661089 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.667815 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44812) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:16.674183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.752298 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.806962 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.837404 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed297a6f-8105-4b4b-8d75-e1b1548405a4,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 888} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848697 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.848697 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.849016 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.849359 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.849869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.850361 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.850839 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Tracked resource versions report: Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: pushed versions: Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: { 'AddressGroup': {'1.2'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'ConntrackHelper': {'1.0'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Log': {'1.0'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Network': {'1.1'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Port': {'1.7'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'PortForwarding': {'1.2'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'QosPolicy': {'1.10'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroup': {'1.5'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SubPort': {'1.0'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Subnet': {'1.1'}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Trunk': {'1.1'}} Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: consumer versions: Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: HyperV agent@hv-cinder-81900: {}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'ConntrackHelper': '1.0', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Log': '1.0', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Network': '1.1', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Port': '1.7', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'PortForwarding': '1.2', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'QosPolicy': '1.10', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroup': '1.5', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SecurityGroupRule': '1.2', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'SubPort': '1.0', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Subnet': '1.1', Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: 'Trunk': '1.1'}} Nov 24 16:22:16.852999 dv-cinder-819007-2-iscsi neutron-server[103142]: {{(pid=103142) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:22:16.855456 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44826) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:16.875299 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.875942 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Added segment 2b6f6661-54d5-4f6c-8764-6630735e25e3 of type vlan for network ca445c7d-56e8-4fcf-9c97-685da788b26d Nov 24 16:22:16.927505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:16.948062 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9dff37e5-98e0-4ffd-881d-685f35ac7c17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.023650 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.025213 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:17.025972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.035767 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-network', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:17.094763 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] Pushing event updated for resources: {'Network': ['ID=ca445c7d-56e8-4fcf-9c97-685da788b26d,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:17.107357 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network ca445c7d-56e8-4fcf-9c97-685da788b26d details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:17.112551 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9d270b30-6348-4e69-953a-5fadf739ce82 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.0960093 Nov 24 16:22:17.115871 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44836) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:17.121502 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Request body: {'subnet': {'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-subnet', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:17.129628 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44838) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:17.159809 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-112565635-network', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:17.184093 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Made reservation on behalf of bf09fa482f8a4598be8a0e8428809467 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:17.186803 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.198684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.201917 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.db.api [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 16:22:17.201917 dv-cinder-819007-2-iscsi neutron-server[103141]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 24 16:22:17.201917 dv-cinder-819007-2-iscsi neutron-server[103141]: [parameters: {'project_id_1': 'b96983a681284ac1a3cb8640a9c716cd', 'expiration_1': datetime.datetime(2021, 11, 24, 16, 21, 57, 170009)}] Nov 24 16:22:17.201917 dv-cinder-819007-2-iscsi neutron-server[103141]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103141) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 16:22:17.202481 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG oslo_db.api [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 16:22:17.258564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Made reservation on behalf of 4ba85d6984964122836595e2e4cf8472 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:17.261074 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.320870 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.377657 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.393001 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:17.412950 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8778970271919', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.413787 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Unsubscribe: segment precommit_create {{(pid=103141) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 16:22:17.414387 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Added segment 6e646b11-a097-4614-8963-01958065282b of type vlan for network 32d52469-d493-4e5e-ad0f-a328c47ce499 Nov 24 16:22:17.465692 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-190108788-network', 'tenant_id': '4cfa849116f74a98b2398d50a2f28cd0'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:17.478500 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61a8d3ac-b712-4abb-86a9-29a27a6adc82,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:17.492107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.494584 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.499785 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.500323 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.501360 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.501864 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.502356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.502862 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.503539 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.504026 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.504536 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.505014 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.505490 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.505974 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Tracked resource versions report: Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: pushed versions: Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: { 'AddressGroup': {'1.2'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'ConntrackHelper': {'1.0'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Log': {'1.0'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Network': {'1.1'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Port': {'1.7'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'PortForwarding': {'1.2'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'QosPolicy': {'1.10'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroup': {'1.5'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SubPort': {'1.0'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Subnet': {'1.1'}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Trunk': {'1.1'}} Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: consumer versions: Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: HyperV agent@hv-cinder-81900: {}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'ConntrackHelper': '1.0', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Log': '1.0', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Network': '1.1', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Port': '1.7', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'PortForwarding': '1.2', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'QosPolicy': '1.10', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroup': '1.5', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SecurityGroupRule': '1.2', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'SubPort': '1.0', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Subnet': '1.1', Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: 'Trunk': '1.1'}} Nov 24 16:22:17.507425 dv-cinder-819007-2-iscsi neutron-server[103141]: {{(pid=103141) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:22:17.539571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Pushing event updated for resources: {'Subnet': ['ID=11e98a82-ac30-426e-b0e8-ea5835b78bca,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:17.570086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Checking segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:17.570671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Network hostable DHCP agents. Network: ca445c7d-56e8-4fcf-9c97-685da788b26d, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:17.624110 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Made reservation on behalf of 4cfa849116f74a98b2398d50a2f28cd0 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:17.626542 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.635647 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.652211 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Network ca445c7d-56e8-4fcf-9c97-685da788b26d is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:17.657619 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.659228 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:17.660147 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.732160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, ca445c7d-56e8-4fcf-9c97-685da788b26d) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:17.736885 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:17.737530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.744768 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc60782c-c2e4-4356-8a51-4deee4441e43 None None] Network ca445c7d-56e8-4fcf-9c97-685da788b26d requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:17.788652 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] Pushing event updated for resources: {'Network': ['ID=32d52469-d493-4e5e-ad0f-a328c47ce499,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:17.812053 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:17.849434 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.857869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44882) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:17.859755 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-361b5955-69d9-4250-b880-cd1440ca7010 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.1905575 Nov 24 16:22:17.872386 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Request body: {'subnet': {'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-subnet', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:17.932276 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.956309 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:17.971389 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Made reservation on behalf of b96983a681284ac1a3cb8640a9c716cd for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:17.974265 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.975212 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f6a2f05-1f09-42bb-b0e0-eff75ae4ca5b None None] Network ca445c7d-56e8-4fcf-9c97-685da788b26d requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:17.981942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c91b838-9c8e-468a-8313-54a782bc511c,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:17.987084 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:17.988037 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Added segment 3447941d-e796-4606-b805-9a893e2dd7cb of type vlan for network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc Nov 24 16:22:18.003797 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.057379 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44886) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:18.058376 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7e87dff1-db93-4686-8584-42f4d9150e87 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.9412282 Nov 24 16:22:18.061985 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.076498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:18.172744 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Made reservation on behalf of bf09fa482f8a4598be8a0e8428809467 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:18.175332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.241509 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.253912 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.254879 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:18.255495 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.316172 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.316172 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.333665 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.366165 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b84f523-bf0f-415a-ba10-8a19cf805fec,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:18.451918 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.3199854 Nov 24 16:22:18.455433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44926) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:18.464801 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Request body: {'subnet': {'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-190108788-subnet', 'tenant_id': '4cfa849116f74a98b2398d50a2f28cd0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:18.476100 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 858} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:18.492784 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be8063a-e00a-4143-b432-2baf981a2eef admin admin] Pushing event updated for resources: {'Network': ['ID=34b3987c-1efb-43da-b25e-b29a5f9ba4cc,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:18.504482 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:18.505347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.537629 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.538097 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Added segment 069d1d08-3607-440c-b8cc-fd16cb843e41 of type vlan for network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 Nov 24 16:22:18.576082 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5326d769-af24-40f0-97f9-e59937e49c37,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:18.586492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Checking segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:18.586900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Network hostable DHCP agents. Network: 32d52469-d493-4e5e-ad0f-a328c47ce499, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:18.594362 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.598498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.634409 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Made reservation on behalf of 4cfa849116f74a98b2398d50a2f28cd0 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:18.636820 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.666380 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:18.833636 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 32d52469-d493-4e5e-ad0f-a328c47ce499) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:18.845464 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-397f94d4-a1e1-4ff3-ba82-d15d4c22175c None None] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:18.852264 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:18.856205 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.923130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.924091 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:18.924726 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.932431 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.979238 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:18.988494 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a2d81a23-fbc9-4b9f-9867-ce560bef3a09 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.1290479 Nov 24 16:22:18.996774 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44936) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:19.014363 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-32d52469-d493-4e5e-ad0f-a328c47ce499', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:22:19.015475 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.041849 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:19.064529 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] Pushing event updated for resources: {'Network': ['ID=92d9ce23-f297-4622-a4e7-b9b5a8f48b19,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:19.091633 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:19.109446 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5a02c365-5301-48d1-9f84-76ef767bb61b,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:19.123331 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-bdd80ff3-1250-4cc6-a0db-4c9be9d871d2 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 2.2670867 Nov 24 16:22:19.126539 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44940) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:19.144378 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Checking segment: {'id': '3447941d-e796-4606-b805-9a893e2dd7cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:19.145037 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Network hostable DHCP agents. Network: 34b3987c-1efb-43da-b25e-b29a5f9ba4cc, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:19.169237 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Request body: {'subnet': {'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-112565635-subnet', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:19.213133 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:19.216755 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.218118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.276480 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Allocated IP 172.20.0.2 (32d52469-d493-4e5e-ad0f-a328c47ce499/5326d769-af24-40f0-97f9-e59937e49c37/45e41fb9-096b-49f6-99af-8020c19bcce2) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:19.314590 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-92e7a68e-a2d7-43b9-9c84-531938519d3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.345746 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.346879 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44942) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:19.353099 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 34b3987c-1efb-43da-b25e-b29a5f9ba4cc) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:19.371641 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:19.372292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.391091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46c2251c-0c9b-4197-98b7-c3d85de94968 None None] Network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:19.402673 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Made reservation on behalf of b96983a681284ac1a3cb8640a9c716cd for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:19.408975 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.485111 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44948) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:19.515605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44952) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:19.519195 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.560290 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.673525 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d67d2206-4e6e-49ba-87df-cb92222bef84 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2123902 Nov 24 16:22:19.726222 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.780483 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2b07da7-79b3-4072-91ab-f1fe3ed247b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.798413 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35272b2a-3207-47b5-beab-3afe2c6d111e None None] Network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:19.863955 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-779cfdb7-0f7f-4c89-8cd7-5e388c45486c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.864540 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-524040ae-37be-449d-aa87-1dbbc01eedd1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.874024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Allocated IP 172.27.2.223 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/0f040003-e6a3-4ac1-bb78-cfe614ec4058) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:19.875842 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.922557 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:19.979365 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-779cfdb7-0f7f-4c89-8cd7-5e388c45486c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.077705 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-779cfdb7-0f7f-4c89-8cd7-5e388c45486c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.084351 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.106281 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aaaaeafb-6af7-4460-8050-86d8b3b3deb8,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.155259 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:20.158751 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:20.162678 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:20.170545 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-524040ae-37be-449d-aa87-1dbbc01eedd1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.178043 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2b07da7-79b3-4072-91ab-f1fe3ed247b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.182276 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Pushing event updated for resources: {'Port': ['ID=45e41fb9-096b-49f6-99af-8020c19bcce2,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.182455 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Checking segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:20.182840 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Network hostable DHCP agents. Network: 92d9ce23-f297-4622-a4e7-b9b5a8f48b19, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:20.196136 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.208543 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.208920 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.209271 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.209661 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.210000 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.210580 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.210692 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.211058 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.211405 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.211739 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.212095 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.212419 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Tracked resource versions report: Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: pushed versions: Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: { 'AddressGroup': {'1.2'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'ConntrackHelper': {'1.0'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Log': {'1.0'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Network': {'1.1'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Port': {'1.7'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'PortForwarding': {'1.2'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'QosPolicy': {'1.10'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroup': {'1.5'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SubPort': {'1.0'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Subnet': {'1.1'}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Trunk': {'1.1'}} Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: consumer versions: Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: HyperV agent@hv-cinder-81900: {}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'ConntrackHelper': '1.0', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Log': '1.0', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Network': '1.1', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Port': '1.7', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'PortForwarding': '1.2', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'QosPolicy': '1.10', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroup': '1.5', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SecurityGroupRule': '1.2', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'SubPort': '1.0', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Subnet': '1.1', Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: 'Trunk': '1.1'}} Nov 24 16:22:20.213658 dv-cinder-819007-2-iscsi neutron-server[103143]: {{(pid=103143) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:22:20.250113 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Attempting to bind port 45e41fb9-096b-49f6-99af-8020c19bcce2 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:20.250475 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Attempting to bind port 45e41fb9-096b-49f6-99af-8020c19bcce2 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:20.250865 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Attempting to bind port 45e41fb9-096b-49f6-99af-8020c19bcce2 on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:20.253579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-524040ae-37be-449d-aa87-1dbbc01eedd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.267467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 21, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:20.267467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Checking segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:20.267467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.267795 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Bound using segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:20.267984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Bound port: 45e41fb9-096b-49f6-99af-8020c19bcce2, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:20.268393 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.296469 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:20.299384 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2b07da7-79b3-4072-91ab-f1fe3ed247b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.318469 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-779cfdb7-0f7f-4c89-8cd7-5e388c45486c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acba1d67-a5b3-41c2-9463-98b3cec6bdbf,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.320421 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-524040ae-37be-449d-aa87-1dbbc01eedd1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e9b353d472f143c98d05d1b603593fbc&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8027873 Nov 24 16:22:20.323298 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44990) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:20.323653 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 44992) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:20.324373 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-524040ae-37be-449d-aa87-1dbbc01eedd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23fd517a-f6f2-4b0e-9ad2-7fa8ab85f8d6,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.330466 dv-cinder-819007-2-iscsi neutron-server[103141]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 16:22:20.347807 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-779cfdb7-0f7f-4c89-8cd7-5e388c45486c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4904facae84c4eb9b8a68648479c27d7&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9938054 Nov 24 16:22:20.351079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 44996) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:20.354255 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] For port 45e41fb9-096b-49f6-99af-8020c19bcce2, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:20.356655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] For port 45e41fb9-096b-49f6-99af-8020c19bcce2, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=45e41fb9-096b-49f6-99af-8020c19bcce2,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:20.372572 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.392404 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.412416 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.435185 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e2b07da7-79b3-4072-91ab-f1fe3ed247b1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3057da8930334468a4065a20d903d012&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9434032 Nov 24 16:22:20.449587 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 92d9ce23-f297-4622-a4e7-b9b5a8f48b19) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:20.459763 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45002) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:20.469096 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cee1b7a3-61e8-45c6-88b3-ae4912ff9094 None None] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:20.476141 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b07da7-79b3-4072-91ab-f1fe3ed247b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e83f1805-e9b0-44ab-87c6-3647465dc5cf,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.491534 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:20.492136 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.562436 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.565113 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec450d5b-45d8-45ba-8c32-c8f1dd4f4571 None None] Pushing event updated for resources: {'Port': ['ID=45e41fb9-096b-49f6-99af-8020c19bcce2,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.607558 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:20.619312 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.623484 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.633523 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:20.638149 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:20.655091 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.660379 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.702351 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:22:20.703275 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.751406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.858614 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8d8a661a-bd12-4c57-b4f2-92684be7f570 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.6737127 Nov 24 16:22:20.858614 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45008) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:20.858614 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Pushing event updated for resources: {'Port': ['ID=0f040003-e6a3-4ac1-bb78-cfe614ec4058,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:20.858614 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:20.862353 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-29936da3-1489-43b3-a8e5-9be32668dee1 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:20.862353 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-29936da3-1489-43b3-a8e5-9be32668dee1 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/networks?id=34b3987c-1efb-43da-b25e-b29a5f9ba4cc HTTP/1.1" status: 200 len: 811 time: 0.5350230 Nov 24 16:22:20.888727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.907226 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-3f8c887d-9721-4ee7-a554-5ab37b2c2f32 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/quotas/4cfa849116f74a98b2398d50a2f28cd0 HTTP/1.1" status: 200 len: 375 time: 0.0163383 Nov 24 16:22:20.952704 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.959234 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:20.959234 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/acba1d67-a5b3-41c2-9463-98b3cec6bdbf HTTP/1.1" status: 204 len: 168 time: 0.6008847 Nov 24 16:22:20.970771 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Allocated IP 172.20.0.2 (92d9ce23-f297-4622-a4e7-b9b5a8f48b19/aaaaeafb-6af7-4460-8050-86d8b3b3deb8/f5cab198-4c84-4ca1-b4e3-c018dcb416f6) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:20.972674 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Allocated IP 172.27.2.198 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/771d4bab-124a-4166-b812-d6b11b97b345) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:20.996956 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d1b1a7-22fa-4f49-930e-f0a9bd7ecbc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acba1d67-a5b3-41c2-9463-98b3cec6bdbf,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.032744 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-aef0b7e1-48a8-4ccd-b201-a06accc28938 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1171381 Nov 24 16:22:21.042140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.045359 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.052062 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e83f1805-e9b0-44ab-87c6-3647465dc5cf HTTP/1.1" status: 204 len: 168 time: 0.5910666 Nov 24 16:22:21.075919 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6080f50-471f-494a-a926-d76dbdb8a449 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e83f1805-e9b0-44ab-87c6-3647465dc5cf,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.090732 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.092111 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.141684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.193625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.214781 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.251690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.322449 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.351717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.371360 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:21.375364 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:21.379323 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:21.388969 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Pushing event updated for resources: {'Port': ['ID=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.474974 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:21.483308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:21.502557 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:21.535407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Attempting to bind port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:21.535407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Attempting to bind port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:21.535407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Attempting to bind port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:21.552557 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 21, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:21.553081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Checking segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:21.553883 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.554381 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Bound using segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:21.555014 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Bound port: f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:21.559654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.679032 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.682177 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.683362 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/23fd517a-f6f2-4b0e-9ad2-7fa8ab85f8d6 HTTP/1.1" status: 204 len: 168 time: 1.3547084 Nov 24 16:22:21.713914 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.729723 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Pushing event updated for resources: {'Port': ['ID=771d4bab-124a-4166-b812-d6b11b97b345,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.738996 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] For port f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:21.742644 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] For port f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:21.750363 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3288e282-1f5b-4002-a574-48766ba3b41d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23fd517a-f6f2-4b0e-9ad2-7fa8ab85f8d6,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.757847 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.783739 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.812796 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:21.884906 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf53f19-f558-41b3-8444-b816e9a60279 None None] Pushing event updated for resources: {'Port': ['ID=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:21.984631 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf531ba9-1f44-4ade-b39d-966899488e06 None None] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:22.030639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45044) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:22.063076 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] Provisioning complete for port 45e41fb9-096b-49f6-99af-8020c19bcce2 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:22.063572 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.064828 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.136304 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45046) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:22.181571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.295287 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.307386 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-462d113f-c2ba-4990-b8ff-6e587525315c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.353892 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] For port 45e41fb9-096b-49f6-99af-8020c19bcce2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=45e41fb9-096b-49f6-99af-8020c19bcce2,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:22.377929 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5c248be0-04e6-4b61-a8b1-ee3ca38fe038 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.424455 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.468691 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-06ae310b-1f4a-49d7-82c4-1c444d6f9662 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:22:22.469713 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-06ae310b-1f4a-49d7-82c4-1c444d6f9662 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.9042094 Nov 24 16:22:22.485470 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.509908 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5c248be0-04e6-4b61-a8b1-ee3ca38fe038 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.522179 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbbec77-34d8-4dd3-85c7-d60d98041bcd None None] Pushing event updated for resources: {'Port': ['ID=45e41fb9-096b-49f6-99af-8020c19bcce2,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:22.594295 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.604965 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5c248be0-04e6-4b61-a8b1-ee3ca38fe038 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.615172 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device f5cab198-4c84-4ca1-b4e3-c018dcb416f6 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:22.651079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.681146 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-462d113f-c2ba-4990-b8ff-6e587525315c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.682102 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-5c248be0-04e6-4b61-a8b1-ee3ca38fe038 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4b645e92ae274524b43308c65e3e5614&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6499012 Nov 24 16:22:22.682596 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.683181 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c248be0-04e6-4b61-a8b1-ee3ca38fe038 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57d8c1e9-9870-4f3e-b7ac-3fb969486078,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:22.708305 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-196d2f77-1b40-4380-9087-2c698c784186 None None] Provisioning complete for port 45e41fb9-096b-49f6-99af-8020c19bcce2 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:22.708816 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-196d2f77-1b40-4380-9087-2c698c784186 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.794552 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Allocated IP 172.27.2.176 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/73d4ea20-e85e-4a14-86b5-e0d5e6335e61) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:22.843597 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:22.843982 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:22.853052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45054) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:22.959704 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.014305 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-462d113f-c2ba-4990-b8ff-6e587525315c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.037809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.048190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.051191 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-462d113f-c2ba-4990-b8ff-6e587525315c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=226c9ba7-5179-435f-bb88-04cc3fd1319c,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.063402 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.098975 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.126266 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-462d113f-c2ba-4990-b8ff-6e587525315c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d0637b2d780848709d174c4e3181ffdf&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9878392 Nov 24 16:22:23.129614 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45066) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:23.140259 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:23.158351 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:23.173862 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-50f9ca03-7f37-4a6b-a7f9-d72ca51f9912 service neutron] 10.222.0.82 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6495738 Nov 24 16:22:23.178383 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:23.187431 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:23.212861 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.215559 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.219049 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/57d8c1e9-9870-4f3e-b7ac-3fb969486078 HTTP/1.1" status: 204 len: 168 time: 0.3628874 Nov 24 16:22:23.222592 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.231721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259f126a-7a36-4b23-ae29-bb12ec4f30be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57d8c1e9-9870-4f3e-b7ac-3fb969486078,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.235918 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.238499 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 45e41fb9-096b-49f6-99af-8020c19bcce2 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:23.278722 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.288044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Router 609a1437-684b-4808-951d-468b7adf3bf0 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:22:23.363567 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:22:23.374888 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Pushing event updated for resources: {'Port': ['ID=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.425595 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.440483 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bb95fa2-34b0-4e39-9a62-99f7c27eafed None None] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:23.457308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:23.472083 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:23.490718 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:23.492815 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:23.543717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.547936 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.552243 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/226c9ba7-5179-435f-bb88-04cc3fd1319c HTTP/1.1" status: 204 len: 168 time: 0.4178805 Nov 24 16:22:23.562628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5ac8e9-3ae6-4da7-a7f7-e0345aa1fa34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=226c9ba7-5179-435f-bb88-04cc3fd1319c,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:23.574295 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.576106 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bf06286b-7721-400e-b03b-f5a7de58e80c admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.5403893 Nov 24 16:22:23.588086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45078) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:23.658162 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-63418a69-52a1-48b2-9c7e-266950de41f2 service neutron] 10.222.0.82 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4743917 Nov 24 16:22:23.688806 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:23.717107 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45082) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:23.726031 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Sync routers for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:23.739766 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:23.771443 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:23.772192 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:23.903679 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:23.910210 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ef40a01f-c93c-4825-ba47-5b63101d1ea6 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 5.8351324 Nov 24 16:22:23.914764 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45092) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:23.949862 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-566d7d92-8f8c-45de-ae6e-e656d367dfa1 None None] Provisioning complete for port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:23.950211 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-566d7d92-8f8c-45de-ae6e-e656d367dfa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.014873 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:24.016862 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.136581 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:24.139827 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Updating router 609a1437-684b-4808-951d-468b7adf3bf0 port 771d4bab-124a-4166-b812-d6b11b97b345 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:24.230567 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.250960 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45106) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:24.274506 dv-cinder-819007-2-iscsi neutron-server[103142]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 16:22:24.373099 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72cfbbff-f4e3-4f17-8550-cef69d6bc5cc req-d4a2b40d-8fcb-4c48-abf7-400e97919555 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.1125450 Nov 24 16:22:24.373240 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2dc9a8ce-6675-4d76-b21d-110f1d390b2c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.513089 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 45e41fb9-096b-49f6-99af-8020c19bcce2 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:24.514236 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.582721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.627650 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.779719 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:24.838184 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:24.868965 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.016318 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2dc9a8ce-6675-4d76-b21d-110f1d390b2c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.028916 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 45e41fb9-096b-49f6-99af-8020c19bcce2 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:25.092002 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Allocated IP 172.20.0.1 (32d52469-d493-4e5e-ad0f-a328c47ce499/5326d769-af24-40f0-97f9-e59937e49c37/382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:25.098019 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2dc9a8ce-6675-4d76-b21d-110f1d390b2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.109700 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Pushing event updated for resources: {'Port': ['ID=771d4bab-124a-4166-b812-d6b11b97b345,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:25.132422 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc9a8ce-6675-4d76-b21d-110f1d390b2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed81c013-a8cd-4ce6-a088-bb5388689d53,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:25.134217 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Attempting to bind port 771d4bab-124a-4166-b812-d6b11b97b345 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:25.135389 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Attempting to bind port 771d4bab-124a-4166-b812-d6b11b97b345 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:25.135961 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Attempting to bind port 771d4bab-124a-4166-b812-d6b11b97b345 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:25.151690 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.152078 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.152441 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.152822 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.153121 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.170052 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.170052 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.170052 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.170052 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.170052 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.171940 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.172477 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Tracked resource versions report: Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: pushed versions: Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: { 'AddressGroup': {'1.2'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'ConntrackHelper': {'1.0'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Log': {'1.0'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Network': {'1.1'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Port': {'1.7'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'PortForwarding': {'1.2'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'QosPolicy': {'1.10'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroup': {'1.5'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroupRule': {'1.2'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SubPort': {'1.0'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Subnet': {'1.1'}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Trunk': {'1.1'}} Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: consumer versions: Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: { DHCP agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: HyperV agent@hv-cinder-81900: {}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: L3 agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: Metadata agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: Metering agent@dv-cinder-819007-2-iscsi: {}, Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: Open vSwitch agent@dv-cinder-819007-2-iscsi: { 'AddressGroup': '1.2', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'ConntrackHelper': '1.0', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Log': '1.0', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Network': '1.1', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Port': '1.7', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'PortForwarding': '1.2', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'QosPolicy': '1.10', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroup': '1.5', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SecurityGroupRule': '1.2', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'SubPort': '1.0', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Subnet': '1.1', Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: 'Trunk': '1.1'}} Nov 24 16:22:25.173745 dv-cinder-819007-2-iscsi neutron-server[103144]: {{(pid=103144) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 16:22:25.182328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-2a0fb7dd-ce89-42f2-a17d-96562715bb88 None None] Provisioning complete for port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:25.182860 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2a0fb7dd-ce89-42f2-a17d-96562715bb88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.185407 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:25.187278 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:25.188470 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.189620 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:25.191489 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Bound port: 771d4bab-124a-4166-b812-d6b11b97b345, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:25.195154 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.254216 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2dc9a8ce-6675-4d76-b21d-110f1d390b2c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f990668c8b6046b6a07ac2f09f2be9c8&name=default HTTP/1.1" status: 200 len: 2994 time: 1.5325520 Nov 24 16:22:25.255209 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45142) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:25.346496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.362298 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.386348 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] For port 771d4bab-124a-4166-b812-d6b11b97b345, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:25.397764 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] For port 771d4bab-124a-4166-b812-d6b11b97b345, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=771d4bab-124a-4166-b812-d6b11b97b345,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:25.406289 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.412504 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 45e41fb9-096b-49f6-99af-8020c19bcce2 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:25.413079 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.458877 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:22:25.472957 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.501764 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.567642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.572039 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.573108 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed81c013-a8cd-4ce6-a088-bb5388689d53 HTTP/1.1" status: 204 len: 168 time: 0.3167412 Nov 24 16:22:25.575528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device f5cab198-4c84-4ca1-b4e3-c018dcb416f6 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:25.580460 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:25.586716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:25.594588 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b820a49b-97bb-47bf-bfd5-9f357cd21a2e None None] Pushing event updated for resources: {'Port': ['ID=771d4bab-124a-4166-b812-d6b11b97b345,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:25.596549 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:25.600661 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:25.600791 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:25.600791 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:25.616619 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:25.641263 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Checking router: bdc4341e-4d45-47fe-80d6-6f412a2b97e4 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:25.641943 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Updating router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:25.646390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:25.652533 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5bb02d-474b-45a1-baa6-52719ad51fca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed81c013-a8cd-4ce6-a088-bb5388689d53,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:25.736663 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Pushing event updated for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:25.755798 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-698bf483-f96b-4db0-a50b-476919e5eca0 req-6b9485fa-5943-4b95-9b71-090d0485de61 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.1141639 Nov 24 16:22:26.090545 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.093717 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.094489 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:26.094489 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:26.094489 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:26.096441 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.096441 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9e2ec51c-4b9a-4aa1-a937-064ceee31897 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 5.2152395 Nov 24 16:22:26.096441 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45162) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:26.096887 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:26.096887 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.097123 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:26.129008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-7e69a51a-7266-42d1-9225-2072160d2ad2 None None] Provisioning complete for port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:26.129386 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-7e69a51a-7266-42d1-9225-2072160d2ad2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.211539 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-7e69a51a-7266-42d1-9225-2072160d2ad2 None None] Port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:26.357286 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.373928 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.435723 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:26.455853 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Allocated IP 172.20.0.1 (ca445c7d-56e8-4fcf-9c97-685da788b26d/11e98a82-ac30-426e-b0e8-ea5835b78bca/b73dc8ef-33b5-42c7-a949-ea14ee78b964) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:26.543610 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.647638 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Attempting to bind port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:26.648355 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Attempting to bind port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:26.648355 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Attempting to bind port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:26.673066 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.674201 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:26.674626 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:26.675073 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.675476 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:26.675980 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Bound port: 0f040003-e6a3-4ac1-bb78-cfe614ec4058, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:26.676392 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.679890 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d7c340-9d95-4560-b89a-820a7d8223a8 None None] Pushing event updated for resources: {'Port': ['ID=0f040003-e6a3-4ac1-bb78-cfe614ec4058,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:26.742228 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.760632 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:26.787701 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] For port 0f040003-e6a3-4ac1-bb78-cfe614ec4058, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:26.790988 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] For port 0f040003-e6a3-4ac1-bb78-cfe614ec4058, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0f040003-e6a3-4ac1-bb78-cfe614ec4058,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:26.814171 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-972e8df8-aa88-43fc-9c43-7053a42e45aa None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:26.820388 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.823997 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.839270 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:23Z', 'revision_number': 3, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:26.884691 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:26.884691 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Updating router 8c1be576-3043-4dba-941b-81d9ad17cae0 port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:26.905167 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:26.923246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Pushing event updated for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:26.939330 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.022798 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e27d6e02-d61f-4142-98a8-00c80b8f30ce req-d4a4ba63-88f5-4c43-8a8e-9bd46a6585f8 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.0927227 Nov 24 16:22:27.039279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.039495 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:27.040490 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:27.168216 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:27.170265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:27.184243 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d7c340-9d95-4560-b89a-820a7d8223a8 None None] Pushing event updated for resources: {'Port': ['ID=0f040003-e6a3-4ac1-bb78-cfe614ec4058,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:27.197213 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.293037 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Network ca445c7d-56e8-4fcf-9c97-685da788b26d is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:27.319144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:27.343744 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:27.351349 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.376984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:27.585291 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:22:27.686805 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.730313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-4bbed42b-2924-4b9b-bd9d-c35263c4088f None None] Provisioning complete for port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:27.731358 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4bbed42b-2924-4b9b-bd9d-c35263c4088f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.733605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Pushing event updated for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:27.768019 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.799930 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-4bbed42b-2924-4b9b-bd9d-c35263c4088f None None] Port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:27.905283 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:27.914177 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:27.926236 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2e5657a3-b9a2-4bbc-bdfc-ac8dd0a4fb68 admin admin] 10.222.0.82 "PUT /v2.0/routers/609a1437-684b-4808-951d-468b7adf3bf0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3370118 Nov 24 16:22:27.938097 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Attempting to bind port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:27.938468 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Attempting to bind port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:27.938830 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Attempting to bind port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:27.956294 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Allocated IP 172.20.0.1 (92d9ce23-f297-4622-a4e7-b9b5a8f48b19/aaaaeafb-6af7-4460-8050-86d8b3b3deb8/18dfb356-e285-4b88-a549-7d0518916134) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:27.958809 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9be58b-52e4-41bf-a189-2885c1bacedf None None] Pushing event updated for resources: {'Port': ['ID=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:27.970961 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:27.972102 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:27.972425 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:27.972811 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:27.973303 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Bound port: 73d4ea20-e85e-4a14-86b5-e0d5e6335e61, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:27.973700 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.091530 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] For port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:28.107617 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] For port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:28.166869 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.201449 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf08e865-ffd5-44cd-ba05-e372cceeb774 None None] The sync data for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi is: [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:21Z', 'revision_number': 3, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:28.239576 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.289120 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:28.291288 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:28.294358 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a9be58b-52e4-41bf-a189-2885c1bacedf None None] Pushing event updated for resources: {'Port': ['ID=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:28.404132 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-eda9eec3-d01b-4842-8f70-e4f525e642c9 req-6648db97-6470-4303-bb11-8823305c8460 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.0622613 Nov 24 16:22:28.422325 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.469544 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:28.595493 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.637472 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.696347 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:28.720813 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.729534 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:28.744898 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:28.745516 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.756079 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:23Z', 'revision_number': 3, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:28.785735 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d95c807-d42e-4638-a47e-28c89e879d3f None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:23Z', 'revision_number': 3, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:28.832212 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.833179 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:28.906242 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Pushing event updated for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:29.072638 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0f040003-e6a3-4ac1-bb78-cfe614ec4058 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:29.242692 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.84', 52578) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:29.288407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-b6458fcb-1011-46de-8e23-e788d3c7b925 None None] Provisioning complete for port 18dfb356-e285-4b88-a549-7d0518916134 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:29.290762 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b6458fcb-1011-46de-8e23-e788d3c7b925 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.298790 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Pushing event updated for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:29.380146 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:29.380525 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.394076 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Network ca445c7d-56e8-4fcf-9c97-685da788b26d is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:29.440628 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:29.523859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-b6458fcb-1011-46de-8e23-e788d3c7b925 None None] Port 18dfb356-e285-4b88-a549-7d0518916134 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:29.619694 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.633014 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.710716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45254) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:29.720185 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group': {'name': 'tempest-securitygroup--971490092', 'description': 'tempest-description--720662537'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:29.723970 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 0f040003-e6a3-4ac1-bb78-cfe614ec4058, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0f040003-e6a3-4ac1-bb78-cfe614ec4058,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:29.726635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-55740816-e26b-40d2-9d72-f9b1bfedb6fc req-dbacee41-46b3-4b70-b02c-ecde587792bd tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.1092327 Nov 24 16:22:29.795561 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.796521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 771d4bab-124a-4166-b812-d6b11b97b345 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:29.813225 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-c80cd4fd-5b8e-45e3-ab81-82b95d54df0b tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:29.815284 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-c80cd4fd-5b8e-45e3-ab81-82b95d54df0b tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.84 "GET /v2.0/networks?id=34b3987c-1efb-43da-b25e-b29a5f9ba4cc HTTP/1.1" status: 200 len: 811 time: 0.5703869 Nov 24 16:22:29.864198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:29.870172 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:29.900052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Request body: {'port': {'device_id': 'd210a764-7424-422d-9801-74723813c79f', 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc', 'admin_state_up': True, 'tenant_id': '4cfa849116f74a98b2398d50a2f28cd0'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:29.914008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:29.915470 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:30.030004 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=0f040003-e6a3-4ac1-bb78-cfe614ec4058,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:30.070426 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 771d4bab-124a-4166-b812-d6b11b97b345 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:30.070814 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.175507 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.270012 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.291913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:30.399598 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.406417 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.6944253 Nov 24 16:22:30.409649 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45280) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:30.434400 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group_rule': {'security_group_id': 'de2a5fd9-7646-41b3-85bc-62821b2cc1e7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:30.448147 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b9d64d-1d68-4bf8-970a-2ce81a43958a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroup': ['ID=de2a5fd9-7646-41b3-85bc-62821b2cc1e7,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:30.541757 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:22:30.566747 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Made reservation on behalf of 4cfa849116f74a98b2398d50a2f28cd0 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:30.572636 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.597428 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.693695 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 771d4bab-124a-4166-b812-d6b11b97b345, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=771d4bab-124a-4166-b812-d6b11b97b345,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:30.792855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.810541 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.812114 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.907984 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.909263 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:30.911236 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=771d4bab-124a-4166-b812-d6b11b97b345,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:30.968412 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 2, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:31.062951 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:31.063352 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Updating router 609a1437-684b-4808-951d-468b7adf3bf0 port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:31.077010 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Allocated IP 172.20.0.3 (34b3987c-1efb-43da-b25e-b29a5f9ba4cc/5a02c365-5301-48d1-9f84-76ef767bb61b/564f023d-54aa-4048-a3af-1322467f81e9) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:31.112212 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Pushing event updated for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:31.116507 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:31.148679 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a1147d83-6267-4d78-89ce-9efb9a0f7cfe admin admin] 10.222.0.82 "PUT /v2.0/routers/bdc4341e-4d45-47fe-80d6-6f412a2b97e4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2278762 Nov 24 16:22:31.163915 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:31.179563 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-98d8db9a-d9f3-4119-bd3b-7228da714523 req-75bb23c1-c396-49bb-bd4b-2f9570ba38ee tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.1368101 Nov 24 16:22:31.209735 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:31.397038 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:31.404042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:31.405120 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:31.426621 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:31.466020 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:31.469177 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:31.589421 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:31.757211 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Sync routers for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:31.808890 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:31.812205 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:31.825823 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:22:31.828239 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.076209 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.132200 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:32.206343 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:22:32.212954 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.214138 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7993143 Nov 24 16:22:32.236195 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-f636edd4-44c6-4624-b55b-1f8993145141 admin admin] 10.222.0.82 "PUT /v2.0/routers/8c1be576-3043-4dba-941b-81d9ad17cae0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1862881 Nov 24 16:22:32.236195 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4b5bc8-c381-490c-9239-68f522d5f8b7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7bc74a34-49ec-48e2-8036-fc6e09376bdd,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:32.249119 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:22:32.250740 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45340) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:32.264319 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group_rule': {'security_group_id': 'de2a5fd9-7646-41b3-85bc-62821b2cc1e7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:32.268335 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:32.300966 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.302227 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0f040003-e6a3-4ac1-bb78-cfe614ec4058 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:32.347896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Pushing event updated for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:32.358687 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:32.361039 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:32.372256 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:32.389883 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:32.395954 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.409418 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-37cbcce1-e55d-489d-9506-86bb0ba24bd8 None None] Provisioning complete for port 18dfb356-e285-4b88-a549-7d0518916134 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:32.410022 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-37cbcce1-e55d-489d-9506-86bb0ba24bd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.469940 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb256ea-be56-4538-a90f-21098d220bf8 req-37a9d44b-6fd7-4d27-9062-bfb16c13436c tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:32.472770 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-abb256ea-be56-4538-a90f-21098d220bf8 req-37a9d44b-6fd7-4d27-9062-bfb16c13436c tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 931 time: 0.1349885 Nov 24 16:22:32.517915 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:32.518307 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.590684 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-37cbcce1-e55d-489d-9506-86bb0ba24bd8 None None] Port 18dfb356-e285-4b88-a549-7d0518916134 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:32.596131 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:32.596752 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:32.605607 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-abb256ea-be56-4538-a90f-21098d220bf8 req-e3864c25-6375-4b62-af96-c7a4399d0ca6 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1258476 Nov 24 16:22:32.612583 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.640348 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.719062 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-61498a17-125e-4ea8-9641-6a8a572c112f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8321326 Nov 24 16:22:32.727958 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:32.738242 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-8cc882b2-6f3a-454d-a47c-78707db1ef31 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:22:32.739716 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-8cc882b2-6f3a-454d-a47c-78707db1ef31 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0115764 Nov 24 16:22:32.786081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:32.874269 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:27Z', 'revision_number': 4, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'b73dc8ef-33b5-42c7-a949-ea14ee78b964', 'name': '', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'mac_address': 'fa:16:3e:aa:e3:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:25Z', 'updated_at': '2021-11-24T16:22:28Z', 'revision_number': 2, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'subnets': [{'id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:32.887966 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:32.923808 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Checking router: bdc4341e-4d45-47fe-80d6-6f412a2b97e4 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:32.924258 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Updating router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 port b73dc8ef-33b5-42c7-a949-ea14ee78b964 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:32.987957 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.368683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45362) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:33.537036 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:33.556523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b5454dad-a5c3-460e-8b2f-a74b3c0b2eb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.728434 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.730131 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:33.732654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.794871 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b5454dad-a5c3-460e-8b2f-a74b3c0b2eb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.799537 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Request body: {'port': {'device_id': 'd210a764-7424-422d-9801-74723813c79f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:33.830869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 2, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:33.846595 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.879088 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:22:33.879489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Updating router 8c1be576-3043-4dba-941b-81d9ad17cae0 port 18dfb356-e285-4b88-a549-7d0518916134 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:22:33.881498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e0d74be-18a2-44f7-8140-1480064a4082,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:33.882258 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.939074 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.942230 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-d0314ca1-b01a-4f2d-8263-6854c8e17e41 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:33.943778 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-d0314ca1-b01a-4f2d-8263-6854c8e17e41 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 819 time: 0.3682311 Nov 24 16:22:33.947056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b5454dad-a5c3-460e-8b2f-a74b3c0b2eb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.957886 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f2e4413-eb7d-434b-a910-1a55bf27e1c7 None None] Pushing event updated for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:33.958099 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.982491 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:33.982491 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4674e7ea-aca4-43e2-a8b2-b7405d5db7f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.7270164 Nov 24 16:22:33.985223 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45392) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:34.001431 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:34.074104 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-84178fe5-2f61-4c9a-a5ef-eaec3e5d5ab8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/quotas/4ba85d6984964122836595e2e4cf8472 HTTP/1.1" status: 200 len: 375 time: 0.1051662 Nov 24 16:22:34.110075 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.115726 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 771d4bab-124a-4166-b812-d6b11b97b345 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:34.178841 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45398) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:34.185699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1877920438', 'description': 'tempest-description--2058614426'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:34.253024 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4aec723-e822-445d-84ef-7021448d5064 None None] Pushing event updated for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:34.268715 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Attempting to bind port b73dc8ef-33b5-42c7-a949-ea14ee78b964 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:34.269347 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Attempting to bind port b73dc8ef-33b5-42c7-a949-ea14ee78b964 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:34.269868 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Attempting to bind port b73dc8ef-33b5-42c7-a949-ea14ee78b964 on network ca445c7d-56e8-4fcf-9c97-685da788b26d {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:34.280471 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b5454dad-a5c3-460e-8b2f-a74b3c0b2eb6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7e064b0f010a4ff381956996952333a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9106479 Nov 24 16:22:34.280996 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:34.281552 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Checking segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:34.282289 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.282832 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Bound using segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:34.283507 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Bound port: b73dc8ef-33b5-42c7-a949-ea14ee78b964, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:34.284074 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.287161 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45400) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:34.423494 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] For port b73dc8ef-33b5-42c7-a949-ea14ee78b964, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:34.427853 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] For port b73dc8ef-33b5-42c7-a949-ea14ee78b964, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b73dc8ef-33b5-42c7-a949-ea14ee78b964,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:34.463050 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f00d116-f9f2-4983-98e7-1d7cb4492433 req-f43c3331-964a-42de-b3da-dffed645b43f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:34.464577 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6f00d116-f9f2-4983-98e7-1d7cb4492433 req-f43c3331-964a-42de-b3da-dffed645b43f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 931 time: 0.2005637 Nov 24 16:22:34.485245 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5454dad-a5c3-460e-8b2f-a74b3c0b2eb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=576f24b9-4873-4ef7-af7a-9002c5655d83,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:34.525447 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.546496 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-965518f5-d0fc-470d-89c1-c6a722fd1efa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4644637 Nov 24 16:22:34.558134 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.573776 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Attempting to bind port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:34.574332 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Attempting to bind port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:34.575219 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Attempting to bind port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:34.628880 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:34.629493 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Checking segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:34.630061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.630613 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Bound using segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:34.631286 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Bound port: 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:34.631835 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.640316 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-4f7c1cd4-89ff-4e9c-b479-df86336459b4 None None] Provisioning complete for port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:34.640924 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4f7c1cd4-89ff-4e9c-b479-df86336459b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.674738 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6f00d116-f9f2-4983-98e7-1d7cb4492433 req-aa0393c6-a47e-4158-9f5e-7900857bc373 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1994042 Nov 24 16:22:34.682996 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.762463 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:34.763530 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:34.768000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.796721 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:34.820889 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-5632d6ff-2d8b-4408-8ddd-5542b0f59948 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:22:34.822000 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-5632d6ff-2d8b-4408-8ddd-5542b0f59948 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1135235 Nov 24 16:22:34.851098 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 771d4bab-124a-4166-b812-d6b11b97b345 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:34.851627 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.019667 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4aec723-e822-445d-84ef-7021448d5064 None None] Pushing event updated for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=4']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:35.059723 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-4f7c1cd4-89ff-4e9c-b479-df86336459b4 None None] Port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:35.061246 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.068762 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.069928 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/576f24b9-4873-4ef7-af7a-9002c5655d83 HTTP/1.1" status: 204 len: 168 time: 0.7497380 Nov 24 16:22:35.127934 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5996eb6d-6f7c-4edf-aecf-43719905be87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=576f24b9-4873-4ef7-af7a-9002c5655d83,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:35.171828 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-618f1135-e5ec-49b7-a95f-e1d019752d98 service neutron] 10.222.0.82 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3423786 Nov 24 16:22:35.183420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 564f023d-54aa-4048-a3af-1322467f81e9 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:35.218525 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.295561 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.312234 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] For port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:35.322959 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:35.358446 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] For port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:35.382244 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.422287 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.468977 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.522780 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.535002 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Transition to ACTIVE for port object 564f023d-54aa-4048-a3af-1322467f81e9 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:35.541865 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.613235 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9c4a8c-e7d7-4e76-b034-0845fcb0833f None None] Pushing event updated for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:35.615021 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:35.638261 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Allocated IP 172.27.2.100 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/bdaccf32-22f3-4dee-9493-0318026d6f60) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:35.676574 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8a05627c-85c0-4f51-a603-abe87c5bc110 service neutron] 10.222.0.82 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4667583 Nov 24 16:22:35.698130 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.801227 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.803771 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-81838e41-daa1-4938-a438-eb83cc294b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.6229982 Nov 24 16:22:35.808661 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45428) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:35.819638 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group_rule': {'security_group_id': 'b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:35.824662 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:27Z', 'revision_number': 4, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'b73dc8ef-33b5-42c7-a949-ea14ee78b964', 'name': '', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'mac_address': 'fa:16:3e:aa:e3:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:25Z', 'updated_at': '2021-11-24T16:22:34Z', 'revision_number': 4, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'subnets': [{'id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:35.957500 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bfa1ed8-3361-46c5-8772-ecb6bbda2c09 None None] The sync data for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi is: [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:22:27Z', 'revision_number': 4, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'b73dc8ef-33b5-42c7-a949-ea14ee78b964', 'name': '', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'mac_address': 'fa:16:3e:aa:e3:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_interface', 'standard_attr_id': 102, 'fixed_ips': [{'subnet_id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:25Z', 'updated_at': '2021-11-24T16:22:34Z', 'revision_number': 4, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'subnets': [{'id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:35.985229 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:35.987286 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.137049 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-214851b2-3fef-4f28-b621-2d113498b7c8 req-3505c58f-77d9-49d7-9f16-a2619882caf8 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:36.150519 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-214851b2-3fef-4f28-b621-2d113498b7c8 req-3505c58f-77d9-49d7-9f16-a2619882caf8 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.2596617 Nov 24 16:22:36.157032 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:36.157682 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:36.217169 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Pushing event updated for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:36.236044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Attempting to bind port 564f023d-54aa-4048-a3af-1322467f81e9 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:36.238684 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Attempting to bind port 564f023d-54aa-4048-a3af-1322467f81e9 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '3447941d-e796-4606-b805-9a893e2dd7cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:36.238684 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Attempting to bind port 564f023d-54aa-4048-a3af-1322467f81e9 on network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:36.244541 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Port 564f023d-54aa-4048-a3af-1322467f81e9 on network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:36.244862 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Attempting to bind port 564f023d-54aa-4048-a3af-1322467f81e9 on network 34b3987c-1efb-43da-b25e-b29a5f9ba4cc {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:36.252885 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:36.253392 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Checking segment: {'id': '3447941d-e796-4606-b805-9a893e2dd7cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:36.254249 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Bound using segment: {'id': '3447941d-e796-4606-b805-9a893e2dd7cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:36.254898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Bound port: 564f023d-54aa-4048-a3af-1322467f81e9, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3447941d-e796-4606-b805-9a893e2dd7cb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:36.255495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.270565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Attempting to bind port 18dfb356-e285-4b88-a549-7d0518916134 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:36.283463 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Attempting to bind port 18dfb356-e285-4b88-a549-7d0518916134 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:36.283869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Attempting to bind port 18dfb356-e285-4b88-a549-7d0518916134 on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:36.377532 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-214851b2-3fef-4f28-b621-2d113498b7c8 req-ee87c69d-b98b-46d5-b7f4-1d2aec662c61 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1908193 Nov 24 16:22:36.396264 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.425711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45446) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:36.495531 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b4b325a-a52a-41c0-bb54-c114737e276f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.499856 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:36.503247 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.539566 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cb881118-34f1-4082-87ef-b71ecdc361f1 req-97adc2bf-56f7-48e5-aff2-18120c06bdd3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 210 time: 0.0920401 Nov 24 16:22:36.590697 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:36.614583 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=564f023d-54aa-4048-a3af-1322467f81e9,segment=NetworkSegment(3447941d-e796-4606-b805-9a893e2dd7cb),segment_id=3447941d-e796-4606-b805-9a893e2dd7cb)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:36.670699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:36.687291 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Checking segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:36.687832 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.688402 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Bound using segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:36.689077 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Bound port: 18dfb356-e285-4b88-a549-7d0518916134, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:36.689654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.722626 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.732624 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f2e4413-eb7d-434b-a910-1a55bf27e1c7 None None] Pushing event updated for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:36.759197 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-b834ad4c-be26-4827-bafb-00c2ab018e66 None None] Provisioning complete for port 18dfb356-e285-4b88-a549-7d0518916134 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:36.759702 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b834ad4c-be26-4827-bafb-00c2ab018e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.836073 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:36.837928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:36.840151 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] 10.222.0.84 "PUT /v2.0/ports/564f023d-54aa-4048-a3af-1322467f81e9 HTTP/1.1" status: 200 len: 1093 time: 3.2623181 Nov 24 16:22:36.841141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:36.890365 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-b834ad4c-be26-4827-bafb-00c2ab018e66 None None] Port 18dfb356-e285-4b88-a549-7d0518916134 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:37.045620 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b20e6b-9190-4cc8-bb16-d73938d00aad service neutron] Pushing event updated for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:37.091960 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.202166 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] For port 18dfb356-e285-4b88-a549-7d0518916134, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:37.279705 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b4b325a-a52a-41c0-bb54-c114737e276f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.319709 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-8ea203b5-6cfa-44f7-a047-8b4cc53a92e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:37.321307 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-8ea203b5-6cfa-44f7-a047-8b4cc53a92e8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 1096 time: 0.2718031 Nov 24 16:22:37.333115 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:37.338241 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] For port 18dfb356-e285-4b88-a549-7d0518916134, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=18dfb356-e285-4b88-a549-7d0518916134,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:37.340036 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] Provisioning complete for port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:37.340458 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.365604 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d12241cf-deba-450b-9d12-8c08b6c51521,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:37.398102 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=bdaccf32-22f3-4dee-9493-0318026d6f60,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:37.409671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7bcab03-9b79-4e03-9b38-d1c82761f270" -d '{"events": [{"name": "network-changed", "server_uuid": "d210a764-7424-422d-9801-74723813c79f", "tag": "564f023d-54aa-4048-a3af-1322467f81e9"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:37.421969 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:37.428341 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:37.657564 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b4b325a-a52a-41c0-bb54-c114737e276f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.713294 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b73dc8ef-33b5-42c7-a949-ea14ee78b964 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:37.715288 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.722555 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45496) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:37.727743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group_rule': {'security_group_id': 'b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:37.733057 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-92d21216-6e69-40fa-8417-4c7182114668 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.9229393 Nov 24 16:22:37.739506 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:37.761405 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63db79d9-a984-437a-9a73-7859ea9c0b5f x-openstack-request-id: req-63db79d9-a984-437a-9a73-7859ea9c0b5f {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:37.761685 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d210a764-7424-422d-9801-74723813c79f", "tag": "564f023d-54aa-4048-a3af-1322467f81e9", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:37.762083 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-63db79d9-a984-437a-9a73-7859ea9c0b5f {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:37.762672 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9', 'status': 'completed', 'code': 200} Nov 24 16:22:37.826198 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9b4b325a-a52a-41c0-bb54-c114737e276f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e8b3abb30b5c4cdfa0c58058911a076c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3986447 Nov 24 16:22:37.827100 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45498) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:37.838859 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b4b325a-a52a-41c0-bb54-c114737e276f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2a94a09-cc93-4ef7-94dc-14ed51030a08,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:37.974330 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.011766 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.033930 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-2b6ab282-3ab2-4b29-a99f-c32debe3cc1f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:38.041745 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-2b6ab282-3ab2-4b29-a99f-c32debe3cc1f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 819 time: 1.1167839 Nov 24 16:22:38.067496 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:22:38.074856 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-d94a8dde-17e2-43e1-a624-640fc7859523 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/quotas/4ba85d6984964122836595e2e4cf8472 HTTP/1.1" status: 200 len: 375 time: 0.0288441 Nov 24 16:22:38.076395 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:38.091735 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9c4a8c-e7d7-4e76-b034-0845fcb0833f None None] Pushing event updated for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.142386 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.156161 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98464974-f628-409c-bc58-4122626aede7 req-2dae65c8-51d8-4ba7-8e95-d53dd039fb3d tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:38.163958 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-98464974-f628-409c-bc58-4122626aede7 req-2dae65c8-51d8-4ba7-8e95-d53dd039fb3d tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.3027596 Nov 24 16:22:38.196928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.198077 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-9aa5e82b-157d-4207-bc99-9d1e18d48834 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1221793 Nov 24 16:22:38.215388 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.230724 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.236315 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port b73dc8ef-33b5-42c7-a949-ea14ee78b964 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:38.236940 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.276023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:35Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:38.277100 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-98464974-f628-409c-bc58-4122626aede7 req-16d63547-c70f-4fbe-8527-fc1c24e48494 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117003 Nov 24 16:22:38.303338 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.319679 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-8d4909ee-9ffb-400e-bf9d-77d75a569a5c service neutron] 10.222.0.82 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1134753 Nov 24 16:22:38.331062 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20ecc9b9-e829-4144-9168-ab28809e635f,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.350416 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93cf294c-fd95-4435-848e-04f27cde0fcf None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:35Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:38.367155 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.371787 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.375723 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.375723 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b2a94a09-cc93-4ef7-94dc-14ed51030a08 HTTP/1.1" status: 204 len: 168 time: 0.5455539 Nov 24 16:22:38.384930 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] For port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:38.388279 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b2a9f7-921b-4350-9d59-df8739930225 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2a94a09-cc93-4ef7-94dc-14ed51030a08,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.401835 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:22:38.406147 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.411144 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-653965d4-a1a0-4270-92c9-6484bf878667 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6873739 Nov 24 16:22:38.411995 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45512) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:38.418142 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:38.500404 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-68d94955-3986-48fe-ab82-0bcae3d34f02 service neutron] 10.222.0.82 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1564703 Nov 24 16:22:38.511728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.603229 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.629382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.657532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.687186 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9343d563-5148-4784-ab42-c1d38df3df0c None None] Pushing event updated for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.717361 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] Provisioning complete for port 18dfb356-e285-4b88-a549-7d0518916134 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:38.721554 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.721800 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port b73dc8ef-33b5-42c7-a949-ea14ee78b964, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b73dc8ef-33b5-42c7-a949-ea14ee78b964,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:38.766058 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.789906 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.795614 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.838090 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.905981 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=bdaccf32-22f3-4dee-9493-0318026d6f60,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.924855 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:37Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:22:38.925901 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:38.930189 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.973828 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:38.983208 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dd517b90-b7b3-411e-8ed4-2d09417d5aef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.9879491 Nov 24 16:22:38.991494 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dfe91c5-6d9d-4fb2-b4bf-9d1d98a0d77c None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:37Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:22:39.052921 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] For port 18dfb356-e285-4b88-a549-7d0518916134, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=18dfb356-e285-4b88-a549-7d0518916134,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:39.097504 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.191923 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-396e41a5-6197-4700-af59-ebe181f50ecb req-0bf5fc00-72fd-4b37-b49e-cc0b3f582849 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0348673 Nov 24 16:22:39.228516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ecb5a2f-7ef4-4a10-9c99-3350d25a819a None None] Pushing event updated for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:39.429858 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Allocated IP 172.27.2.92 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/c830f907-66cc-47ae-a88c-4a8c642eb8da) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:39.634297 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad81c53-ce55-4e07-87f3-464ed7c8cac4 req-d8555eb7-a15c-4449-904d-28f8b97e3d62 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:39.647621 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ad81c53-ce55-4e07-87f3-464ed7c8cac4 req-d8555eb7-a15c-4449-904d-28f8b97e3d62 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.1447554 Nov 24 16:22:39.738526 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8db3d03c-81f4-423f-925b-40979f8d5be8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--971490092&fields=id&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 267 time: 0.1459296 Nov 24 16:22:39.747300 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:39.867224 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:39.875595 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ad81c53-ce55-4e07-87f3-464ed7c8cac4 req-e7c8a1d6-ad44-49b9-8722-5dfc0dffa5a3 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2259519 Nov 24 16:22:40.003176 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:40.004148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.058531 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-103dc37d-239a-4b84-93f3-3da58c547419 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:40.060120 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-103dc37d-239a-4b84-93f3-3da58c547419 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 817 time: 0.3194251 Nov 24 16:22:40.061457 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-84f8424f-4f07-4d2e-873c-dcec34ff5730 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=564f023d-54aa-4048-a3af-1322467f81e9 HTTP/1.1" status: 200 len: 217 time: 0.2648115 Nov 24 16:22:40.093558 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-b9d53cb9-ce78-4202-8434-112124109d4d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/quotas/bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 375 time: 0.0231547 Nov 24 16:22:40.159555 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b73dc8ef-33b5-42c7-a949-ea14ee78b964 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:40.215589 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-24183b18-9c69-42ed-8c04-3ad08c02d8b0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1136713 Nov 24 16:22:40.259053 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port b73dc8ef-33b5-42c7-a949-ea14ee78b964 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:40.259838 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.318289 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0918b439-78e2-4937-ab16-44ee951faa5f req-2f2dc26b-6a8d-43d0-84aa-e134f5c8f325 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0494466 Nov 24 16:22:40.368592 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.462473 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-c65565f5-ffb5-40c3-b3ae-98fac4f5bc77 service neutron] 10.222.0.82 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2408464 Nov 24 16:22:40.476311 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:40.504992 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:40.507565 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=c830f907-66cc-47ae-a88c-4a8c642eb8da,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:40.520459 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:40.535197 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 18dfb356-e285-4b88-a549-7d0518916134 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:40.632091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 18dfb356-e285-4b88-a549-7d0518916134 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:40.632477 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.783460 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:40.816116 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-0f9f39db-d403-4158-9416-bb78fd385b4a service neutron] 10.222.0.82 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3516219 Nov 24 16:22:40.932816 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:41.138030 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edea631-07b9-4a44-be26-e22bca419dd4 req-058f4b45-ba8e-4b0b-a313-70af3e4b5a54 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:41.154690 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4edea631-07b9-4a44-be26-e22bca419dd4 req-058f4b45-ba8e-4b0b-a313-70af3e4b5a54 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.1562333 Nov 24 16:22:41.287021 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4edea631-07b9-4a44-be26-e22bca419dd4 req-058489ef-3928-408e-92fb-fdce1d443532 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1309018 Nov 24 16:22:41.322418 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-12b9ad49-429f-475e-89f3-d2eb80f277bb req-78912723-c93f-496b-aea1-f030165c1618 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0991235 Nov 24 16:22:41.421435 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:41.506979 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-22e187f1-e1e5-45ce-8aa9-a8bda2fbc186 req-7587f005-88ca-45b5-a73f-b02565b5146a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0638068 Nov 24 16:22:41.535866 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:41.587577 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:41.601510 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=c830f907-66cc-47ae-a88c-4a8c642eb8da,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:41.666003 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:41.675943 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f22b16c1-96b4-4a66-b7ce-fcf8531bd822 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 3.2535026 Nov 24 16:22:41.964396 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-f35f3d8e-b922-46e4-aed5-c14c27bbfbba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1877920438&fields=id&tenant_id=b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 267 time: 0.0660772 Nov 24 16:22:42.145231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-27967964-a10a-4e5e-ab0d-bdce0dc69a09 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:42.151386 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-27967964-a10a-4e5e-ab0d-bdce0dc69a09 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 810 time: 0.1806548 Nov 24 16:22:42.162587 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-c9a5b6fc-c404-4390-80b5-ef442d1d6a12 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/quotas/b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 375 time: 0.0097172 Nov 24 16:22:42.214486 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-55e479f0-40ed-4bf4-8066-ba3516c472f6 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0463035 Nov 24 16:22:42.309811 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-981c1b03-7eaf-4a25-896d-588f57ba6311 service neutron] 10.222.0.82 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836773 Nov 24 16:22:42.410066 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-23a527f0-b4f0-48c3-8691-8ab8fa454b02 service neutron] 10.222.0.82 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939090 Nov 24 16:22:42.420665 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2638aa86-277c-4f2a-8e61-ca864369243a req-847fdaa0-0869-4c12-bec6-f1de3e690687 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:42.422175 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2638aa86-277c-4f2a-8e61-ca864369243a req-847fdaa0-0869-4c12-bec6-f1de3e690687 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.0502911 Nov 24 16:22:42.471733 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2638aa86-277c-4f2a-8e61-ca864369243a req-e1c03ff2-aca5-450e-8a4c-119a636dda40 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426939 Nov 24 16:22:42.561084 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c4120ce5-83e4-438e-9a92-ce00e7c5e0b7 req-83f57070-0913-4c46-b791-5c13c29dff7a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0275149 Nov 24 16:22:42.780573 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-842677c9-0a1a-4cb4-9eaa-0310a101058f req-666ff01c-388b-4e7d-90b3-79e8b45b5209 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.1033773 Nov 24 16:22:42.811778 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-269ec96f-3d48-4ba2-aff4-9cc959efc37e req-614c7903-40de-4f75-bd4e-87861ac25264 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0486376 Nov 24 16:22:43.596192 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c881c8dc-bc63-4390-ab9b-dbc7eec4303b req-1db28a8e-d355-47cf-b4e4-b4b64ac765e6 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:43.598302 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c881c8dc-bc63-4390-ab9b-dbc7eec4303b req-1db28a8e-d355-47cf-b4e4-b4b64ac765e6 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.0514877 Nov 24 16:22:43.694715 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c881c8dc-bc63-4390-ab9b-dbc7eec4303b req-7ac91795-48a0-4285-bb10-80ffcf779e4e tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860989 Nov 24 16:22:43.706161 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a89c18d3-ead2-4223-8805-bdec3b97803a req-878d6417-a38f-49af-afd3-a56e676c97ed tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0292609 Nov 24 16:22:43.907494 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-77a10e1b-f3ee-4a37-9259-a12b8e5d59de req-93321054-1f7c-4bb3-a2d1-aff37fbe7482 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0619962 Nov 24 16:22:43.923913 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e589924e-e709-41e2-89c9-e689a147a629 req-25ebe544-5128-441d-a568-af50b710e4d2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0378551 Nov 24 16:22:44.833752 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6db836d-fc18-4712-a8a6-27c19396d8d3 req-3c75226e-4c55-404d-85dc-4a515169a67b tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:44.840411 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-74125405-e6c4-4348-9b49-736997422aeb req-4f9b4979-1ec2-433c-8f60-7a9685ef8c5c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0409043 Nov 24 16:22:44.841947 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6db836d-fc18-4712-a8a6-27c19396d8d3 req-3c75226e-4c55-404d-85dc-4a515169a67b tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.0609276 Nov 24 16:22:44.918469 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6db836d-fc18-4712-a8a6-27c19396d8d3 req-2a70d576-cc8f-4c77-b0c4-ce6389f8b9c6 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672171 Nov 24 16:22:45.046339 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ffb8ff50-0789-4413-9232-b4c0df3dbea5 req-e59967a9-64c1-41ad-b6fc-01b01b5d7be4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0352435 Nov 24 16:22:45.068435 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fd5588a5-1180-483f-8681-a20df09eab6f req-6e3a9109-d4c3-4011-a12c-c1ea2b41c3ee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0375428 Nov 24 16:22:45.986637 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89829ac9-adf4-493f-98d0-b10e31062663 req-fa54d827-168a-4ab8-a686-cd30f2860382 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0438783 Nov 24 16:22:46.063216 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126c94b4-6e27-4512-9aa8-e336552caa9e req-9082cbcf-7740-4527-85db-0379b48b9499 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:46.064578 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-126c94b4-6e27-4512-9aa8-e336552caa9e req-9082cbcf-7740-4527-85db-0379b48b9499 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.0514028 Nov 24 16:22:46.127952 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-126c94b4-6e27-4512-9aa8-e336552caa9e req-46568509-67fe-4de9-9c7d-a20c9f560a62 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568945 Nov 24 16:22:46.206356 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3b79fab1-ae33-4f7f-afa3-d5039d8e8083 req-7dadc776-a0a9-463a-b753-4a9917c6401e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0731862 Nov 24 16:22:46.256030 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a33dfde-87a7-4712-834b-e1a29caaa70d req-f30aa93f-4642-42e9-96f7-06b1494f95cf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0366979 Nov 24 16:22:47.075715 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fce18fd1-f299-4867-8085-45856aa8cb70 req-51ff79aa-1123-4ca2-9e7c-3c60dec5cd1b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0273399 Nov 24 16:22:47.114368 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d543d90c-467b-4021-93c2-e7838bc77fa2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:47.282864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09eecd7-4d6b-4d41-b245-188edf8aec98 req-1d4e9d9d-68ac-4dc5-8b81-40798098ea32 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:47.284721 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a09eecd7-4d6b-4d41-b245-188edf8aec98 req-1d4e9d9d-68ac-4dc5-8b81-40798098ea32 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.0644417 Nov 24 16:22:47.313929 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4a212df0-c814-490e-8ea3-18e3a8b031d2 req-0057c230-a764-4686-8a64-dc93abf4c037 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0332417 Nov 24 16:22:47.348440 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a09eecd7-4d6b-4d41-b245-188edf8aec98 req-42964fd9-9a94-4398-a990-c88749e414a5 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565031 Nov 24 16:22:47.418578 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-66305a47-484d-43a6-a652-045f7e86fec9 req-4b3ea5bf-4244-463e-9b1a-e418345a07fb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0306542 Nov 24 16:22:47.783889 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-0eda340e-4cb8-4485-87d9-2737183d77a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:47.785705 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-0eda340e-4cb8-4485-87d9-2737183d77a9 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5a02c365-5301-48d1-9f84-76ef767bb61b HTTP/1.1" status: 200 len: 851 time: 0.0544972 Nov 24 16:22:47.803231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45828) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:47.884055 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-746876cc-150d-46b9-8eed-9a3b8d5d612f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=34b3987c-1efb-43da-b25e-b29a5f9ba4cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0540826 Nov 24 16:22:47.907102 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-32570538-4e9f-40e1-b65c-2adfb4f4cfad admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.060061 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-32570538-4e9f-40e1-b65c-2adfb4f4cfad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.064152 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-fd0ec652-0406-41d4-a2ff-14a604d81bc8 service neutron] 10.222.0.84 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1183152 Nov 24 16:22:48.147952 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-32570538-4e9f-40e1-b65c-2adfb4f4cfad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.224479 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a4d15d8-acad-4ef8-b85e-3a56345dc849 req-eb8f06e2-8775-4bed-89f7-8de3a8b4d03c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0514452 Nov 24 16:22:48.233215 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-32570538-4e9f-40e1-b65c-2adfb4f4cfad admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b2f910ee486442c9a2fcdcfb0a9faeae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4288800 Nov 24 16:22:48.235923 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45850) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:48.238741 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32570538-4e9f-40e1-b65c-2adfb4f4cfad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e94feb1f-afb0-498c-984b-1470c9cb45da,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:48.252003 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b896de1c-a03a-4d13-b0b3-4a12c4ab5874 req-62809b6f-c733-4300-93ee-71ac97d208e1 service neutron] 10.222.0.84 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1707585 Nov 24 16:22:48.309802 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.333032 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.429215 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-99067fbd-7ba7-4b4b-bbf4-31eb5f3eed58 req-250bd93a-d204-43e0-89b8-f84f3f9a803c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0331089 Nov 24 16:22:48.432650 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-888a495e-4d6f-44f6-ab47-9e21b117cb42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:48.434081 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-888a495e-4d6f-44f6-ab47-9e21b117cb42 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 1096 time: 0.0722022 Nov 24 16:22:48.503408 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.503408 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:48.503819 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e94feb1f-afb0-498c-984b-1470c9cb45da HTTP/1.1" status: 204 len: 168 time: 0.2664726 Nov 24 16:22:48.533912 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dab2cef4-f387-43bc-a5d4-71a73a616809 req-0428bcbe-6ec1-49a2-a55d-4b3ea5e40e7e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0453615 Nov 24 16:22:48.541200 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554266e8-802f-4425-a1f2-3576c8f82fc1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e94feb1f-afb0-498c-984b-1470c9cb45da,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:48.752479 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa0598f-294c-439f-a157-29f70244ae6a req-c0cc44a9-4135-4a68-afd5-57097a2a2fb2 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:48.754009 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6aa0598f-294c-439f-a157-29f70244ae6a req-c0cc44a9-4135-4a68-afd5-57097a2a2fb2 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.3190625 Nov 24 16:22:48.802042 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-19a349fe-0ea1-4dbd-930d-ea5f70933543 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:48.803518 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-19a349fe-0ea1-4dbd-930d-ea5f70933543 service neutron] 10.222.0.84 "GET /v2.0/networks?id=34b3987c-1efb-43da-b25e-b29a5f9ba4cc HTTP/1.1" status: 200 len: 912 time: 0.3597126 Nov 24 16:22:48.857315 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-13dd16e0-6adc-4a0e-978f-428ebe7820fe service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=564f023d-54aa-4048-a3af-1322467f81e9 HTTP/1.1" status: 200 len: 217 time: 0.0461745 Nov 24 16:22:48.861161 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6aa0598f-294c-439f-a157-29f70244ae6a req-2d68dbc2-1686-47e0-ab7f-c4611e10765a tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0963142 Nov 24 16:22:48.862501 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.84', 52614) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:48.927123 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-9d833a78-06c4-4617-aa22-053aa2394e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:48.928640 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-9d833a78-06c4-4617-aa22-053aa2394e67 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5a02c365-5301-48d1-9f84-76ef767bb61b HTTP/1.1" status: 200 len: 851 time: 0.0566769 Nov 24 16:22:48.970438 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-34185540-0951-487e-9369-de5fb6853a02 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=34b3987c-1efb-43da-b25e-b29a5f9ba4cc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0303507 Nov 24 16:22:48.990877 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-c6a6ea07-37a0-428c-a3b0-5d5a262a6e64 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:48.993150 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-c6a6ea07-37a0-428c-a3b0-5d5a262a6e64 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 819 time: 0.1219299 Nov 24 16:22:49.013337 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Request body: {'port': {'device_id': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'admin_state_up': True, 'tenant_id': '4ba85d6984964122836595e2e4cf8472'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:49.077700 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-b1c53103-92be-4c7b-b878-d0e1f3a58811 service neutron] 10.222.0.84 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923545 Nov 24 16:22:49.192694 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a7bcab03-9b79-4e03-9b38-d1c82761f270 req-3a521c6f-11d9-456b-98e0-be166fcdf002 service neutron] 10.222.0.84 "GET /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045182 Nov 24 16:22:49.228734 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Made reservation on behalf of 4ba85d6984964122836595e2e4cf8472 for: {'port': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:49.232507 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.292350 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4cb2b057-1736-4b59-84e1-5493e1f9a117 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.303681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45886) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:49.326786 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e0ae373f-4b80-44dc-95c5-c11cb6939acb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.393334 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-69ee40b8-5413-4f6a-928d-6f7a0d2b7e9d req-a2bf9a56-e99b-457c-8f0a-65da983d6834 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0348144 Nov 24 16:22:49.501719 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e0ae373f-4b80-44dc-95c5-c11cb6939acb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.551320 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3e9c27b7-03a4-496d-a93d-9dfc96dde9fb req-c9deb1c4-53ad-4321-a101-6f8ba0031b1b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0463824 Nov 24 16:22:49.552503 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Allocated IP 172.20.0.12 (ca445c7d-56e8-4fcf-9c97-685da788b26d/11e98a82-ac30-426e-b0e8-ea5835b78bca/c2678985-882d-4aab-bdae-61a3cf1bd96a) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:49.597366 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e0ae373f-4b80-44dc-95c5-c11cb6939acb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.670008 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45908) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:49.729795 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ae373f-4b80-44dc-95c5-c11cb6939acb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=785f894f-1699-4975-b9be-a23b46f609b8,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:49.752321 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e0ae373f-4b80-44dc-95c5-c11cb6939acb admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4d43689dbf294455b0fa5cfba5ebff9b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4420507 Nov 24 16:22:49.752321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 45914) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:49.811309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-36f13b8e-ca1a-476a-8887-8e370df71fe7 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:49.813008 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-36f13b8e-ca1a-476a-8887-8e370df71fe7 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 810 time: 0.2270474 Nov 24 16:22:49.844962 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.886994 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-387fd2b5-e66a-41ce-87c8-fbc858bcb8ef req-9a7b21d9-d2c3-4de3-9143-eeaba9b005f8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0388834 Nov 24 16:22:49.895062 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:49.923391 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-54d2f664-60e2-4caa-8619-3b9392ef348c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 380 time: 0.0969138 Nov 24 16:22:49.947321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'port': {'device_id': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'admin_state_up': True, 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'security_groups': ['b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:50.015329 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d236b694-d9de-4393-b021-75272eeda975 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.032611 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.071830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1d5e8e-f65b-4fe0-8a1c-ac6a226c2b7a req-1505c862-23b5-4087-b315-0903666378cf tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:50.073297 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ba1d5e8e-f65b-4fe0-8a1c-ac6a226c2b7a req-1505c862-23b5-4087-b315-0903666378cf tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 943 time: 0.1111457 Nov 24 16:22:50.124086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.126461 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.127676 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/785f894f-1699-4975-b9be-a23b46f609b8 HTTP/1.1" status: 204 len: 168 time: 0.3751812 Nov 24 16:22:50.164114 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ba1d5e8e-f65b-4fe0-8a1c-ac6a226c2b7a req-987547a8-53be-49be-a5e9-565789b44c4a tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834212 Nov 24 16:22:50.165240 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8a0fb0-6772-4666-9b8e-f5d64c9282f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=785f894f-1699-4975-b9be-a23b46f609b8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:50.191582 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.200364 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Made reservation on behalf of b96983a681284ac1a3cb8640a9c716cd for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:50.204642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.339912 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d236b694-d9de-4393-b021-75272eeda975 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.343193 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.345362 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Network ca445c7d-56e8-4fcf-9c97-685da788b26d is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:50.346822 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:50.354024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:50.360532 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:50.361174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.362132 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Allocated IP 172.20.0.10 (92d9ce23-f297-4622-a4e7-b9b5a8f48b19/aaaaeafb-6af7-4460-8050-86d8b3b3deb8/a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:50.378422 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Pushing event updated for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:50.393487 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 564f023d-54aa-4048-a3af-1322467f81e9 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:22:50.395078 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.84', 52621) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:50.419114 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d236b694-d9de-4393-b021-75272eeda975 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.472382 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d236b694-d9de-4393-b021-75272eeda975 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1d066039b8d4444d9897745f347bf03f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8013046 Nov 24 16:22:50.473627 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d236b694-d9de-4393-b021-75272eeda975 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05a5c12d-5b86-4720-a7c7-a2cc5c941e4f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:50.478411 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 45934) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:50.537990 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-49275ab3-2cc1-4540-ae03-75088609bf13 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5286739 Nov 24 16:22:50.569718 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=564f023d-54aa-4048-a3af-1322467f81e9,segment=NetworkSegment(3447941d-e796-4606-b805-9a893e2dd7cb),segment_id=3447941d-e796-4606-b805-9a893e2dd7cb)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:50.582816 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Request body: {'port': {'device_id': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:50.587745 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d9c23518-c292-411f-a1c6-d0a5307ffe6f req-41578831-d910-46db-a874-c0ffd49f3cde tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0485060 Nov 24 16:22:50.599273 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '564f023d-54aa-4048-a3af-1322467f81e9', 'network_id': '34b3987c-1efb-43da-b25e-b29a5f9ba4cc', 'port_id': '564f023d-54aa-4048-a3af-1322467f81e9', 'mac_address': 'fa:16:3e:0e:12:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 896, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5a02c365-5301-48d1-9f84-76ef767bb61b', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:22:50.614518 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.645395 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.649621 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-cea56ac7-3eef-4e9e-bb5c-cf471b1e7bdb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:50.653246 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-cea56ac7-3eef-4e9e-bb5c-cf471b1e7bdb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 817 time: 0.2547879 Nov 24 16:22:50.705201 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.725910 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.730839 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 564f023d-54aa-4048-a3af-1322467f81e9 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:50.730983 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:50.759829 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=564f023d-54aa-4048-a3af-1322467f81e9,segment=NetworkSegment(3447941d-e796-4606-b805-9a893e2dd7cb),segment_id=3447941d-e796-4606-b805-9a893e2dd7cb)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:50.811605 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a6a8d24a-a0f5-495a-abf5-fb280a8787b3 req-545fc140-a83c-41b9-a52c-71149b69efff tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.1235707 Nov 24 16:22:50.822183 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8025467a-bfd9-415f-9064-e5c15a6c885a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 379 time: 0.1580088 Nov 24 16:22:50.840989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'port': {'device_id': '5ede480a-9913-493f-bedc-9103638bc19b', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'admin_state_up': True, 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'security_groups': ['de2a5fd9-7646-41b3-85bc-62821b2cc1e7']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:50.868746 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.046558 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.076710 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.84', 52624) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:51.128785 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:51.136577 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Made reservation on behalf of bf09fa482f8a4598be8a0e8428809467 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:51.140549 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.143702 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.145269 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.145809 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/05a5c12d-5b86-4720-a7c7-a2cc5c941e4f HTTP/1.1" status: 204 len: 168 time: 0.6662624 Nov 24 16:22:51.165012 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:22:51.173369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:51.185185 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['564f023d-54aa-4048-a3af-1322467f81e9'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:22:51.207735 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:51.216261 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:51.233047 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:51.235707 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.239047 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ca049177-114b-472d-9d9c-ef0cd0050130 req-80c90aa3-fa97-40a5-88ce-2c8c15dd2619 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.1023417 Nov 24 16:22:51.259795 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b0ba48c-8772-4d8f-b65e-3471c7abf87d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05a5c12d-5b86-4720-a7c7-a2cc5c941e4f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:51.285006 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2678985-882d-4aab-bdae-61a3cf1bd96a {{(pid=103141) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:51.305530 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.359794 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.provisioning_blocks [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Transition to ACTIVE for port object c2678985-882d-4aab-bdae-61a3cf1bd96a will not be triggered until provisioned by entity L2. {{(pid=103141) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:51.434511 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.605127 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Pushing event updated for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:51.619624 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.managers [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Attempting to bind port c2678985-882d-4aab-bdae-61a3cf1bd96a on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:51.620051 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.managers [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Attempting to bind port c2678985-882d-4aab-bdae-61a3cf1bd96a by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}] {{(pid=103141) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:51.620488 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Attempting to bind port c2678985-882d-4aab-bdae-61a3cf1bd96a on network ca445c7d-56e8-4fcf-9c97-685da788b26d {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:51.626541 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Port c2678985-882d-4aab-bdae-61a3cf1bd96a on network ca445c7d-56e8-4fcf-9c97-685da788b26d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:51.627094 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Attempting to bind port c2678985-882d-4aab-bdae-61a3cf1bd96a on network ca445c7d-56e8-4fcf-9c97-685da788b26d {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:51.632880 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:51.633359 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Checking segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:51.634186 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Bound using segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} {{(pid=103141) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:51.634775 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.managers [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Bound port: c2678985-882d-4aab-bdae-61a3cf1bd96a, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}}] {{(pid=103141) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:51.635275 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.638075 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:51.663256 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-880dff4c-1bef-4f29-8bd3-f076ad6a4a92 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7227147 Nov 24 16:22:51.682725 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-782fc777-84c4-431b-9bbb-a0a810beaecf None None] Provisioning complete for port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:51.682725 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-782fc777-84c4-431b-9bbb-a0a810beaecf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.728116 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-782fc777-84c4-431b-9bbb-a0a810beaecf None None] Port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:51.730474 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Request body: {'port': {'device_id': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:51.758276 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.805672 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a66be86e-bccb-4486-91de-0cce316deca3 req-db883937-b51c-4742-ad38-eb8da781632c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0473804 Nov 24 16:22:51.811980 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Allocated IP 172.20.0.11 (32d52469-d493-4e5e-ad0f-a328c47ce499/5326d769-af24-40f0-97f9-e59937e49c37/be934a2b-3080-4139-8519-7b3fdd48d05e) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:51.818767 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, cleared binding levels {{(pid=103141) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:51.857600 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103141) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:51.896221 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef847b92-a582-4ac7-80d1-3fcd5247c5cd req-cc737db1-e6bf-40d8-88b1-2a9a7e600af0 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:51.897743 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ef847b92-a582-4ac7-80d1-3fcd5247c5cd req-cc737db1-e6bf-40d8-88b1-2a9a7e600af0 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 944 time: 0.5569165 Nov 24 16:22:51.903401 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.926940 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-60582f12-f9ac-45db-877c-ef828c9c1030 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:51.928451 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-60582f12-f9ac-45db-877c-ef828c9c1030 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 819 time: 0.8007486 Nov 24 16:22:51.944291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:51.951567 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Request body: {'port': {'device_id': 'be96317a-e685-455f-b235-c4f37627dd0d', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'admin_state_up': True, 'tenant_id': '4ba85d6984964122836595e2e4cf8472'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:52.010518 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:52.015128 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.015128 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] 10.222.0.84 "PUT /v2.0/ports/c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 1094 time: 1.4409869 Nov 24 16:22:52.015128 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:52.071667 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8812b336-3262-43e5-a94e-fab97d3d1721 service neutron] Pushing event updated for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=3']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:52.082002 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ebd1e4-0b74-4be7-8454-81c9591ee88b req-1247a24e-b550-4da7-b4c7-ca4a18338d86 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:52.083633 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e1ebd1e4-0b74-4be7-8454-81c9591ee88b req-1247a24e-b550-4da7-b4c7-ca4a18338d86 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 932 time: 0.1922209 Nov 24 16:22:52.181906 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e1ebd1e4-0b74-4be7-8454-81c9591ee88b req-8925b06b-3862-4e08-8c90-d934f7bcb2bb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0904438 Nov 24 16:22:52.251000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-84720da9-c4b9-4991-80b9-3708ea9518b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:52.252674 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-84720da9-c4b9-4991-80b9-3708ea9518b0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1097 time: 0.1184859 Nov 24 16:22:52.332016 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.337978 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46012) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:52.384284 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 564f023d-54aa-4048-a3af-1322467f81e9 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:52.428992 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-168a4d1a-ab2a-44a1-8eb1-07752f452a2a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.1667132 Nov 24 16:22:52.454085 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.476355 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ef847b92-a582-4ac7-80d1-3fcd5247c5cd req-faa373fe-03bc-4a0d-8730-68924be39dff tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5568914 Nov 24 16:22:52.515507 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-e91909a0-4c26-4f6a-a19a-f2974359a695 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:52.517083 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-e91909a0-4c26-4f6a-a19a-f2974359a695 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0664537 Nov 24 16:22:52.532557 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cb99acb4-ad33-4012-b069-8a44c90e5338 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.538285 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbbc2aeb-c417-4359-b1ac-5e31bee64971" -d '{"events": [{"name": "network-changed", "server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:52.542216 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-44cb5d0b-e2f5-4ace-97a2-5909c33eadf3 req-319bb800-30c7-4ea2-a009-6acfb8115a2f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.1171906 Nov 24 16:22:52.597655 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-eb176ed8-7d06-4266-a6ed-4d2e8275b87c service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0623438 Nov 24 16:22:52.631538 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 564f023d-54aa-4048-a3af-1322467f81e9 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:22:52.631538 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 564f023d-54aa-4048-a3af-1322467f81e9 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:52.632316 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.712320 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.744321 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.774648 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:52.792814 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-c7297963-9ae7-43e7-a7f6-c40a65f906d4 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1796703 Nov 24 16:22:52.796750 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:52.804027 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Made reservation on behalf of 4ba85d6984964122836595e2e4cf8472 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:52.816446 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.877737 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:52.897038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:52.901654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:52.917431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:52.918787 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.932509 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=564f023d-54aa-4048-a3af-1322467f81e9,segment=NetworkSegment(3447941d-e796-4606-b805-9a893e2dd7cb),segment_id=3447941d-e796-4606-b805-9a893e2dd7cb)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:52.951782 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0c987cc-887f-4f6f-a734-97c291dd2e8f x-openstack-request-id: req-a0c987cc-887f-4f6f-a734-97c291dd2e8f {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:52.952321 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:52.952719 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a0c987cc-887f-4f6f-a734-97c291dd2e8f {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:52.953550 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a', 'status': 'completed', 'code': 200} Nov 24 16:22:52.990144 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:52.997746 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cb99acb4-ad33-4012-b069-8a44c90e5338 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.006870 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:53.017446 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.074703 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Transition to ACTIVE for port object a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:53.088091 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-8c21d80b-5006-4a0a-94b3-d14c798c012e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2560287 Nov 24 16:22:53.104933 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Request body: {'port': {'device_id': '5ede480a-9913-493f-bedc-9103638bc19b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:53.120216 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cb99acb4-ad33-4012-b069-8a44c90e5338 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.122479 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86bb2237-972b-4cbb-8e6c-82f8b2a6d695" -d '{"events": [{"server_uuid": "d210a764-7424-422d-9801-74723813c79f", "name": "network-vif-plugged", "status": "completed", "tag": "564f023d-54aa-4048-a3af-1322467f81e9"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:53.133288 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9447d757-857a-4f2f-b82e-0112200d7ce9 req-741c3666-af33-4330-80b4-2aebe94d7a49 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3307576 Nov 24 16:22:53.156744 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:53.177236 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.214791 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f306369f-0187-4392-847c-abadc0788180 req-0996bbf9-eaaf-4ff5-a9b2-0d864d73ade8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:53.220394 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f306369f-0187-4392-847c-abadc0788180 req-0996bbf9-eaaf-4ff5-a9b2-0d864d73ade8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 932 time: 0.2620590 Nov 24 16:22:53.241095 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e24b5a77-68e8-4def-b27a-04da4102ad42 x-openstack-request-id: req-e24b5a77-68e8-4def-b27a-04da4102ad42 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:53.241597 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d210a764-7424-422d-9801-74723813c79f", "name": "network-vif-plugged", "status": "completed", "tag": "564f023d-54aa-4048-a3af-1322467f81e9", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:53.242577 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e24b5a77-68e8-4def-b27a-04da4102ad42 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:53.243196 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9', 'code': 200} Nov 24 16:22:53.250677 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb99acb4-ad33-4012-b069-8a44c90e5338 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ce671e9-e21d-4660-9179-64ce8692210f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:53.264584 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-cb99acb4-ad33-4012-b069-8a44c90e5338 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e37a7cb4747c4c0682c8abc41a94b815&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9231777 Nov 24 16:22:53.272417 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46056) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:53.273458 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-ba942cdb-a4b5-43ff-8606-e772c586efc5 None None] Provisioning complete for port be934a2b-3080-4139-8519-7b3fdd48d05e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:53.276096 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ba942cdb-a4b5-43ff-8606-e772c586efc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.283739 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Pushing event updated for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:53.361683 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f306369f-0187-4392-847c-abadc0788180 req-ab1c106e-31f1-4143-b2cc-49bdad8cb17b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1315379 Nov 24 16:22:53.361893 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-ba942cdb-a4b5-43ff-8606-e772c586efc5 None None] Port be934a2b-3080-4139-8519-7b3fdd48d05e cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:22:53.418862 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.420665 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Attempting to bind port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:53.420996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Attempting to bind port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:53.421935 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Attempting to bind port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:53.426370 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.440691 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Allocated IP 172.20.0.11 (ca445c7d-56e8-4fcf-9c97-685da788b26d/11e98a82-ac30-426e-b0e8-ea5835b78bca/4d8f106b-a419-4d0a-974c-73ecb7118880) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:22:53.457529 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.464811 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:53.465142 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Attempting to bind port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:53.505507 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-427447b5-8f07-4f61-83dd-39a6b9b77e88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:53.506544 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:53.506544 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Checking segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:53.506544 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Bound using segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:53.507056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Bound port: a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:53.507183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.510209 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-427447b5-8f07-4f61-83dd-39a6b9b77e88 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1097 time: 0.2509944 Nov 24 16:22:53.587658 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ddf36d7-8258-4320-9f46-35cf33990240 req-a93e3273-8585-4280-b80a-3ba915e8a55e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:53.595243 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2ddf36d7-8258-4320-9f46-35cf33990240 req-a93e3273-8585-4280-b80a-3ba915e8a55e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 944 time: 0.2360575 Nov 24 16:22:53.643218 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.647650 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:53.649338 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4ce671e9-e21d-4660-9179-64ce8692210f HTTP/1.1" status: 204 len: 168 time: 0.3759887 Nov 24 16:22:53.763994 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.84', 52631) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:53.776951 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583bf7f2-12b8-4edf-bdf4-4036aec34752 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ce671e9-e21d-4660-9179-64ce8692210f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:53.921868 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:53.965041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:54.008266 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2ddf36d7-8258-4320-9f46-35cf33990240 req-b3cc31b8-d575-4687-8965-8650b3e6cc5f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4113827 Nov 24 16:22:54.046310 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.053006 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a025b7-e282-40c4-a733-b666f1244c80 req-9fa1b072-5b91-4f15-9b89-6ccb91f0bcc2 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.060218 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d1a025b7-e282-40c4-a733-b666f1244c80 req-9fa1b072-5b91-4f15-9b89-6ccb91f0bcc2 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.4096515 Nov 24 16:22:54.077227 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.086789 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-d9b9eec4-2367-488a-8b07-88c91e6b4acf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.088098 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-d9b9eec4-2367-488a-8b07-88c91e6b4acf service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.5690949 Nov 24 16:22:54.130937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a5050e-6424-4b30-9572-cbee95c35306 req-754b1190-f77b-4eea-945a-c75403ff53e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.133411 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33a5050e-6424-4b30-9572-cbee95c35306 req-754b1190-f77b-4eea-945a-c75403ff53e1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 1098 time: 0.3473990 Nov 24 16:22:54.136278 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ba536a7e-1dfe-4e84-b2ab-76dc8dddd330 req-a2cf6879-23e0-4c74-9fb7-3f6e06b8cd8c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0638821 Nov 24 16:22:54.151906 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-079e2f3c-40ac-413f-9a46-dc0633679a96 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0536749 Nov 24 16:22:54.180003 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d1a025b7-e282-40c4-a733-b666f1244c80 req-dd5025b3-e707-42b5-8e8b-2f6d216196e1 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042376 Nov 24 16:22:54.197120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.198018 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.199456 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] 10.222.0.84 "PUT /v2.0/ports/a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 1094 time: 2.4812977 Nov 24 16:22:54.201457 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:54.204698 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3" -d '{"events": [{"name": "network-changed", "server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:54.231904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-33a5050e-6424-4b30-9572-cbee95c35306 req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.281279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-29831f92-4f69-4e7f-a9a6-d00c2214aed2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.285518 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-29831f92-4f69-4e7f-a9a6-d00c2214aed2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.1142669 Nov 24 16:22:54.366547 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-7cfd5073-9eaa-40ad-9a4b-a3ff34b3e71e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0732615 Nov 24 16:22:54.419008 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:54.454624 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c348c10a-1c96-4bad-9f68-a5fe2bee0406 x-openstack-request-id: req-c348c10a-1c96-4bad-9f68-a5fe2bee0406 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:54.454997 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:54.455256 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c348c10a-1c96-4bad-9f68-a5fe2bee0406 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:54.455686 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'status': 'completed', 'code': 200} Nov 24 16:22:54.468097 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.532296 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e129bc8-982f-427e-9fad-1f7db57f8f39 service neutron] Pushing event updated for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:54.559049 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-44f3d7e6-f13f-46a3-98e6-42f292d580d9 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1792843 Nov 24 16:22:54.562217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.576043 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Transition to ACTIVE for port object be934a2b-3080-4139-8519-7b3fdd48d05e will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:54.682868 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a0ec53-ef1d-4587-b77d-d7f7e72a8638 req-bb86ddcc-60c8-4412-a968-01bcfa8b0c22 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.684511 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-46a0ec53-ef1d-4587-b77d-d7f7e72a8638 req-bb86ddcc-60c8-4412-a968-01bcfa8b0c22 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 932 time: 0.1506040 Nov 24 16:22:54.696458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.729659 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Network ca445c7d-56e8-4fcf-9c97-685da788b26d is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:22:54.736075 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-912409ce-a4c8-49bd-999e-e926b40c853a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.738611 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-912409ce-a4c8-49bd-999e-e926b40c853a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1097 time: 0.2392640 Nov 24 16:22:54.756471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:54.784484 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-46a0ec53-ef1d-4587-b77d-d7f7e72a8638 req-5add5282-8cde-439f-868b-3166a29d3ab9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0935678 Nov 24 16:22:54.786530 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-a5644a63-9469-421a-acd5-a9b6c632a4aa service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2144530 Nov 24 16:22:54.791527 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:22:54.810362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:54.811086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:54.852542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Pushing event updated for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:54.868129 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-46034a79-46fe-4b17-b969-e4fde99c9085 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 217 time: 0.1161888 Nov 24 16:22:54.991563 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-de910717-756b-4520-be27-d278fd7e2c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0438943 Nov 24 16:22:55.006081 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-33a5050e-6424-4b30-9572-cbee95c35306 req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.015997 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Request body: {'port': {'device_id': 'be96317a-e685-455f-b235-c4f37627dd0d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:55.023066 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:55.025932 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Attempting to bind port be934a2b-3080-4139-8519-7b3fdd48d05e on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:55.026271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Attempting to bind port be934a2b-3080-4139-8519-7b3fdd48d05e by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:55.026605 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Attempting to bind port be934a2b-3080-4139-8519-7b3fdd48d05e on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:55.059148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-39c07787-575e-450f-a94b-2e958055e500 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.060805 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-39c07787-575e-450f-a94b-2e958055e500 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.1721606 Nov 24 16:22:55.063817 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Port be934a2b-3080-4139-8519-7b3fdd48d05e on network 32d52469-d493-4e5e-ad0f-a328c47ce499 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:55.064154 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Attempting to bind port be934a2b-3080-4139-8519-7b3fdd48d05e on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:55.110349 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:55.110702 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Checking segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:55.111120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Bound using segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:55.111571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Bound port: be934a2b-3080-4139-8519-7b3fdd48d05e, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:55.111930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.129833 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-33a5050e-6424-4b30-9572-cbee95c35306 req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.223242 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46124) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:55.273771 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65974ef8-f302-4837-9806-5edff0aae91e req-fadd5a75-3683-4076-adfb-711c721a2a3c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.281243 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65974ef8-f302-4837-9806-5edff0aae91e req-fadd5a75-3683-4076-adfb-711c721a2a3c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 932 time: 0.0674076 Nov 24 16:22:55.325666 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65974ef8-f302-4837-9806-5edff0aae91e req-30462c3a-13ef-45c4-b624-7d194aaa0602 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436096 Nov 24 16:22:55.333467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1157145593-network', 'tenant_id': 'a0098d29d009430b851aab8500896aee'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:55.395482 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.450446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33a5050e-6424-4b30-9572-cbee95c35306 req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3066711 Nov 24 16:22:55.452047 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ea01e4-6e97-4ff0-8d0c-3501d277316e req-8a9b519a-e6d4-4000-9be5-c09ac5c4a5a3 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.453808 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d2ea01e4-6e97-4ff0-8d0c-3501d277316e req-8a9b519a-e6d4-4000-9be5-c09ac5c4a5a3 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0487311 Nov 24 16:22:55.457692 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Made reservation on behalf of a0098d29d009430b851aab8500896aee for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:55.460206 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.462668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=d286fc8a-be57-453e-bd00-71df9bece619,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:55.475611 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.515628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-cee38b16-ac69-4ce6-b0ee-7aab1e8e1339 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.517110 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-cee38b16-ac69-4ce6-b0ee-7aab1e8e1339 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4436030 Nov 24 16:22:55.532472 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7da3ab9-5d76-42b0-8751-f01ccd8fd845 req-527ca192-f363-4630-a010-cf9a2d61b06f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.534110 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7da3ab9-5d76-42b0-8751-f01ccd8fd845 req-527ca192-f363-4630-a010-cf9a2d61b06f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 944 time: 0.4250820 Nov 24 16:22:55.562138 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d2ea01e4-6e97-4ff0-8d0c-3501d277316e req-4b8afd87-3fdf-48e1-bb41-4c845939b9ce tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905113 Nov 24 16:22:55.576796 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:55.641618 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.677402 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:55.708383 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.731581 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7da3ab9-5d76-42b0-8751-f01ccd8fd845 req-aea7b74a-a1b5-4d1f-8387-6033b01199c0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1891263 Nov 24 16:22:55.739276 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f838ac98-388c-470c-b61f-814e0cf5df9f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:55.750756 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 856} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:55.762282 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.762635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Added segment f9e0c79c-3b55-41ad-a486-7d28f60f6b38 of type vlan for network 87cf40ac-4b6d-405e-ad9a-e401c70cbb37 Nov 24 16:22:55.810481 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.811157 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.907840 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.910254 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.911831 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-742031c3-d163-40b9-8038-3e69240337eb service neutron] 10.222.0.84 "PUT /v2.0/ports/be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 1094 time: 2.8144445 Nov 24 16:22:55.923394 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7571c87-efc6-40b1-81bc-4cf93d6ed73c req-aea1a959-c6ae-4cb9-bef5-807c7eff4e91 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.928132 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e7571c87-efc6-40b1-81bc-4cf93d6ed73c req-aea1a959-c6ae-4cb9-bef5-807c7eff4e91 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0561414 Nov 24 16:22:55.940250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-e44f1d13-bbb6-4b57-ad9c-db3fc00f5584 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2568531 Nov 24 16:22:55.957171 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.958737 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:55.959705 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:55.969482 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742031c3-d163-40b9-8038-3e69240337eb service neutron] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:56.063701 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e7571c87-efc6-40b1-81bc-4cf93d6ed73c req-67d2c95c-e25a-49b8-abc4-3791ef1bf133 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1316993 Nov 24 16:22:56.064720 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] Pushing event updated for resources: {'Network': ['ID=87cf40ac-4b6d-405e-ad9a-e401c70cbb37,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:56.079558 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 87cf40ac-4b6d-405e-ad9a-e401c70cbb37 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:56.103071 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-205e2782-401a-4731-b036-b2add67fee2d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.8757644 Nov 24 16:22:56.106011 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46150) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:56.115009 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Request body: {'subnet': {'network_id': '87cf40ac-4b6d-405e-ad9a-e401c70cbb37', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1157145593-subnet', 'tenant_id': 'a0098d29d009430b851aab8500896aee', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:56.179003 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f19c7b24-43a8-4cc5-9c00-ef48788b7cff req-d5e83d5c-8047-4293-8ee6-f10648765182 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2276504 Nov 24 16:22:56.184852 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-14605b88-fdc1-42f3-8bc4-7cef45645ca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.186250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-14605b88-fdc1-42f3-8bc4-7cef45645ca8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1097 time: 0.1447327 Nov 24 16:22:56.188271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4d8f106b-a419-4d0a-974c-73ecb7118880 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:56.197687 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.217019 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Made reservation on behalf of a0098d29d009430b851aab8500896aee for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:56.219580 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.239330 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-d4529dc9-3108-42dd-b8a5-205748164e8c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 217 time: 0.0431015 Nov 24 16:22:56.246606 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Transition to ACTIVE for port object 4d8f106b-a419-4d0a-974c-73ecb7118880 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:22:56.293198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-1d6a7064-cbe2-4fef-95d2-6397420a2e38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.294773 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-1d6a7064-cbe2-4fef-95d2-6397420a2e38 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0469103 Nov 24 16:22:56.346727 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-82351ad7-d710-4fbb-8a90-acdb0ab18b23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.348248 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-82351ad7-d710-4fbb-8a90-acdb0ab18b23 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448799 Nov 24 16:22:56.384432 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device c2678985-882d-4aab-bdae-61a3cf1bd96a details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:22:56.397000 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.485274 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:56.487525 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbe774ae-566e-4c83-92c7-27ec47d9aea8" -d '{"events": [{"name": "network-changed", "server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:56.508897 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.523842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:56.540545 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'c2678985-882d-4aab-bdae-61a3cf1bd96a', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'port_id': 'c2678985-882d-4aab-bdae-61a3cf1bd96a', 'mac_address': 'fa:16:3e:c5:c9:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 888, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:22:56.560131 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Pushing event updated for resources: {'Subnet': ['ID=588053d7-4857-406f-90b0-437f057cd650,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:56.603576 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.604056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06c8e0b8-b36e-4c9b-9b42-c40882be6e3e x-openstack-request-id: req-06c8e0b8-b36e-4c9b-9b42-c40882be6e3e {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:56.604444 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:56.604701 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-06c8e0b8-b36e-4c9b-9b42-c40882be6e3e {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:56.605208 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'status': 'completed', 'code': 200} Nov 24 16:22:56.612013 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Checking segment: {'id': 'f9e0c79c-3b55-41ad-a486-7d28f60f6b38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '87cf40ac-4b6d-405e-ad9a-e401c70cbb37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:56.612571 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Network hostable DHCP agents. Network: 87cf40ac-4b6d-405e-ad9a-e401c70cbb37, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:56.625056 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2678985-882d-4aab-bdae-61a3cf1bd96a {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:56.648868 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:56.663431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Pushing event updated for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:56.669652 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-f2868bfb-b6e3-4fe9-b0df-f565a8302b98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.671441 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-f2868bfb-b6e3-4fe9-b0df-f565a8302b98 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1097 time: 0.3068841 Nov 24 16:22:56.711602 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Network 87cf40ac-4b6d-405e-ad9a-e401c70cbb37 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:56.720360 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Attempting to bind port 4d8f106b-a419-4d0a-974c-73ecb7118880 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:22:56.720701 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Attempting to bind port 4d8f106b-a419-4d0a-974c-73ecb7118880 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:22:56.721034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Attempting to bind port 4d8f106b-a419-4d0a-974c-73ecb7118880 on network ca445c7d-56e8-4fcf-9c97-685da788b26d {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:56.733103 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-439e4374-dce8-4ed2-91c6-50e4bc64736f service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3754280 Nov 24 16:22:56.742832 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-893d5054-273b-40e0-8652-118c826e993d req-48e7190e-0800-43de-941f-5bb5f92cc9e2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.744341 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-893d5054-273b-40e0-8652-118c826e993d req-48e7190e-0800-43de-941f-5bb5f92cc9e2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 944 time: 0.3013239 Nov 24 16:22:56.754304 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.759266 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Port 4d8f106b-a419-4d0a-974c-73ecb7118880 on network ca445c7d-56e8-4fcf-9c97-685da788b26d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:22:56.759597 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Attempting to bind port 4d8f106b-a419-4d0a-974c-73ecb7118880 on network ca445c7d-56e8-4fcf-9c97-685da788b26d {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:22:56.769752 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edbd7eac-8c4a-4576-aa69-979b6ab487e5 req-3a8ec1bd-60e9-4f7b-8d07-536e2d6aaf2f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.772903 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-edbd7eac-8c4a-4576-aa69-979b6ab487e5 req-3a8ec1bd-60e9-4f7b-8d07-536e2d6aaf2f tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0779121 Nov 24 16:22:56.820547 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:22:56.821064 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Checking segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:56.821278 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Bound using segment: {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:22:56.821690 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Bound port: 4d8f106b-a419-4d0a-974c-73ecb7118880, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2b6f6661-54d5-4f6c-8764-6630735e25e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:22:56.822054 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.825194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:56.842285 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 87cf40ac-4b6d-405e-ad9a-e401c70cbb37) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:56.854455 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-059bce92-7a97-49de-ba77-b6040e31baa4 None None] Network 87cf40ac-4b6d-405e-ad9a-e401c70cbb37 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:56.855572 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:56.856274 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:56.879780 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-edbd7eac-8c4a-4576-aa69-979b6ab487e5 req-dc842112-f726-4742-9299-77f061a5a716 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977201 Nov 24 16:22:56.960264 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-104727ff-920c-4f30-bb24-ee2177b4df43 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8530798 Nov 24 16:22:56.977488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:22:56.981529 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4d8f106b-a419-4d0a-974c-73ecb7118880,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:22:57.018703 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b44bb9c-d1ee-4134-bb76-72db253b11cd None None] Network 87cf40ac-4b6d-405e-ad9a-e401c70cbb37 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:57.021657 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-21378516-fe72-4fc6-9f35-77083b9363cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.023915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-21378516-fe72-4fc6-9f35-77083b9363cc service neutron] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 911 time: 0.3316622 Nov 24 16:22:57.030767 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-893d5054-273b-40e0-8652-118c826e993d req-eec398d7-71c5-421a-bd17-21f0316bcee9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2754586 Nov 24 16:22:57.043070 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3350124a-ba23-4b7b-a5e8-94fe353ebe35 req-d3e4a2ab-895e-4797-bbe4-4d8794a447d2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.049470 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['c2678985-882d-4aab-bdae-61a3cf1bd96a'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:22:57.053727 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3350124a-ba23-4b7b-a5e8-94fe353ebe35 req-d3e4a2ab-895e-4797-bbe4-4d8794a447d2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 944 time: 0.0886450 Nov 24 16:22:57.115247 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:57.121794 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-c56f1f60-7082-4fb1-968b-15bd4c1c5c0e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 217 time: 0.0869455 Nov 24 16:22:57.127852 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db0bffc4-1ed2-4420-9a9a-a2e73b71e7a2 req-7ae34d11-1390-4541-b0dc-6379753c4c43 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3804879 Nov 24 16:22:57.180819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.186984 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:57.188897 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] 10.222.0.84 "PUT /v2.0/ports/4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 200 len: 1094 time: 2.1857679 Nov 24 16:22:57.223783 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3350124a-ba23-4b7b-a5e8-94fe353ebe35 req-8043ceaa-29e6-4074-b8b3-97689e137c99 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1676137 Nov 24 16:22:57.324332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf791be-adfc-4b81-ba00-200d6602f9a8 service neutron] Pushing event updated for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:57.364468 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-4f3717cf-573d-47f9-95b2-ac522763bb5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.365950 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-4f3717cf-573d-47f9-95b2-ac522763bb5d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.2147737 Nov 24 16:22:57.413731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-fb1ba8c9-d6bb-413b-8300-d916c431c7b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.415200 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-fb1ba8c9-d6bb-413b-8300-d916c431c7b2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1097 time: 0.1214211 Nov 24 16:22:57.442239 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9276abb7-32f5-4557-8d23-75c21eb310dd req-c3c04d79-ae82-4119-a11e-56f59fcf2547 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.444243 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9276abb7-32f5-4557-8d23-75c21eb310dd req-c3c04d79-ae82-4119-a11e-56f59fcf2547 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.1964469 Nov 24 16:22:57.747402 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-e1c2d63f-a8ad-47b3-b470-0b4aff27459f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.748897 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-e1c2d63f-a8ad-47b3-b470-0b4aff27459f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3729231 Nov 24 16:22:57.754106 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-3422bf7c-be2a-4aa2-9acc-7b37f9f11dad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.755571 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-3422bf7c-be2a-4aa2-9acc-7b37f9f11dad service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1097 time: 0.3689740 Nov 24 16:22:57.844781 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9276abb7-32f5-4557-8d23-75c21eb310dd req-16b35757-c82f-4c91-88d8-c47f892ec875 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3865860 Nov 24 16:22:57.855666 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-d9b7cc5c-a0fa-4015-8dc2-da362392a3f4 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 200 len: 217 time: 0.0816069 Nov 24 16:22:57.858507 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-319f334a-624e-471f-aebd-65b22e7f18e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:57.859934 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-319f334a-624e-471f-aebd-65b22e7f18e6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.4135702 Nov 24 16:22:57.964409 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-aee4ca56-81a4-48eb-a069-509f929adbc0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 217 time: 0.0767076 Nov 24 16:22:58.016055 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-b4b1beaf-2a9c-40ab-b010-0450ccd66704 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.017526 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-b4b1beaf-2a9c-40ab-b010-0450ccd66704 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.1310768 Nov 24 16:22:58.026656 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77cec6c-ab52-46c1-90a2-e9474a5ffcbd req-013ea53f-f71d-4139-a735-76a888a12e81 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.028400 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a77cec6c-ab52-46c1-90a2-e9474a5ffcbd req-013ea53f-f71d-4139-a735-76a888a12e81 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0523002 Nov 24 16:22:58.030338 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-1f4839d7-8c07-4737-abae-e68bbb2aae63 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2603974 Nov 24 16:22:58.042678 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46220) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:58.047236 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-295890548-network', 'tenant_id': '76f063f002be4305897ca24b6cb36319'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:58.077386 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-4e8fd760-8871-40eb-b67a-fe8343807c83 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0491991 Nov 24 16:22:58.091855 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-bebfc20c-e5c0-48ce-a410-e7a68bef45f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.093284 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-bebfc20c-e5c0-48ce-a410-e7a68bef45f6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.1173356 Nov 24 16:22:58.115736 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a77cec6c-ab52-46c1-90a2-e9474a5ffcbd req-de74eee3-2fc1-43ac-892d-0640b961142a tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804882 Nov 24 16:22:58.182695 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Made reservation on behalf of 76f063f002be4305897ca24b6cb36319 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:58.185192 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.194332 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.293062 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6b3bd9e8-4d3e-4eba-adfe-d8a2c8f52ee3 req-80352580-db80-4735-b555-da7d2812fbe1 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2522852 Nov 24 16:22:58.294865 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-116073c5-32e6-4c0b-b96e-f839088f6aa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.296273 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-116073c5-32e6-4c0b-b96e-f839088f6aa1 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1913607 Nov 24 16:22:58.302476 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-f62f14ed-d302-4570-a4fe-363e2677e50e service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2124736 Nov 24 16:22:58.314894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74737c51-c3c5-4a73-85e9-44ad93a5363b req-457b2b73-0f69-47bb-9bb7-2c9c8f3cdd5f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.320589 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-74737c51-c3c5-4a73-85e9-44ad93a5363b req-457b2b73-0f69-47bb-9bb7-2c9c8f3cdd5f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 944 time: 0.1487188 Nov 24 16:22:58.332077 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.388368 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9019a0-d4b5-4737-898a-88f554c9f405 req-03fbd1bf-8417-47a4-b731-150e1424412c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.395047 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0a9019a0-d4b5-4737-898a-88f554c9f405 req-03fbd1bf-8417-47a4-b731-150e1424412c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 944 time: 0.0510094 Nov 24 16:22:58.399923 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:22:58.424925 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.434655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device c2678985-882d-4aab-bdae-61a3cf1bd96a up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:22:58.475465 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:22:58.480673 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0a9019a0-d4b5-4737-898a-88f554c9f405 req-1072f909-b5ca-41a2-898c-89a9f8225787 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841105 Nov 24 16:22:58.487470 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-74737c51-c3c5-4a73-85e9-44ad93a5363b req-c5274aa3-3f87-400f-b640-9735b4274ec3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538343 Nov 24 16:22:58.502147 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdb3dcd6-ebb0-4e26-9f98-054adbe9108a,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:58.509362 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.509718 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Added segment 786919d5-864e-4e4c-b4e6-07e0d18de950 of type vlan for network a89698c0-50df-47c7-8ceb-e514cf9ec567 Nov 24 16:22:58.520918 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e15bcd75-0e21-453b-bc33-3272f92a6d8f req-809cd580-a8dc-4712-9004-a82a8ae3fa46 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2033839 Nov 24 16:22:58.525693 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-757c566a-8856-4b7c-b7a6-406ccb0d7831 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2064188 Nov 24 16:22:58.565896 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.609447 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:58.611731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e52c38d3-6148-4615-a501-01bc7e7788f0" -d '{"events": [{"name": "network-changed", "server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:58.650175 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbe774ae-566e-4c83-92c7-27ec47d9aea8 req-7dca4be5-416f-416d-a93c-76bdd91fa7a1 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1147051 Nov 24 16:22:58.663740 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d23f514c-7a9d-46ba-a63c-ae69abb2a0e1 x-openstack-request-id: req-d23f514c-7a9d-46ba-a63c-ae69abb2a0e1 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:58.664131 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:58.664485 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d23f514c-7a9d-46ba-a63c-ae69abb2a0e1 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:58.664977 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880', 'status': 'completed', 'code': 200} Nov 24 16:22:58.673339 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:58.691608 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'port_id': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'mac_address': 'fa:16:3e:c7:74:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 858, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:22:58.708909 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.710066 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.711052 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.729553 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-31e6c4dc-b7a7-493f-b749-c412adc02c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.731319 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-31e6c4dc-b7a7-493f-b749-c412adc02c9e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1097 time: 0.0443175 Nov 24 16:22:58.732210 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port c2678985-882d-4aab-bdae-61a3cf1bd96a completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:22:58.734293 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.738566 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.744771 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port c2678985-882d-4aab-bdae-61a3cf1bd96a triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:22:58.745134 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:58.776104 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:22:58.810272 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7665150 Nov 24 16:22:58.812303 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbcd3ef6-68e3-4bf0-944a-3cdec3c2d2f1 admin admin] Pushing event updated for resources: {'Network': ['ID=a89698c0-50df-47c7-8ceb-e514cf9ec567,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:58.815132 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46258) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:22:58.821393 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Request body: {'subnet': {'network_id': 'a89698c0-50df-47c7-8ceb-e514cf9ec567', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-295890548-subnet', 'tenant_id': '76f063f002be4305897ca24b6cb36319', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:22:58.915081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network a89698c0-50df-47c7-8ceb-e514cf9ec567 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:22:58.921930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-442b2e19-1285-4a67-a076-a047977e1059 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:58.923527 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-442b2e19-1285-4a67-a076-a047977e1059 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.1829686 Nov 24 16:22:58.947316 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Made reservation on behalf of 76f063f002be4305897ca24b6cb36319 for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:22:58.948786 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:58.951114 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.014665 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.019260 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-a080caeb-cd58-4f2a-9749-fbefda6b38f2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 200 len: 217 time: 0.0807626 Nov 24 16:22:59.083601 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.085542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-97829034-ea93-4f01-889d-586b50110d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.088944 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-97829034-ea93-4f01-889d-586b50110d49 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0597954 Nov 24 16:22:59.104789 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:59.123104 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:22:59.125530 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5be10554-33d8-46c6-b4a2-0e889c09a9da" -d '{"events": [{"server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "name": "network-vif-plugged", "status": "completed", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:22:59.139057 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:22:59.156215 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-76ea2505-ff1b-4bfc-b880-7a836ae0095f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441728 Nov 24 16:22:59.172481 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a0891a-7066-4044-ace3-80eb0c5f6306 req-a4687e9a-1458-4f0a-9b8f-f439f8eeffc1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.172811 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:22:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe2c6f7f-b492-4507-a348-2dda9cffe8b7 x-openstack-request-id: req-fe2c6f7f-b492-4507-a348-2dda9cffe8b7 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:22:59.173139 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "name": "network-vif-plugged", "status": "completed", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:22:59.173371 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-fe2c6f7f-b492-4507-a348-2dda9cffe8b7 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:22:59.173776 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a', 'code': 200} Nov 24 16:22:59.177487 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-54a0891a-7066-4044-ace3-80eb0c5f6306 req-a4687e9a-1458-4f0a-9b8f-f439f8eeffc1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.1613991 Nov 24 16:22:59.240390 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.280040 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.296962 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:22:59.326112 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-ce55e671-b717-4dd8-a8de-422924c6f1c2 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1474853 Nov 24 16:22:59.379927 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5de10e6e-9444-4d3a-932d-4fe9b84515c8,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:59.380169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-54a0891a-7066-4044-ace3-80eb0c5f6306 req-bf7f63b1-02de-48a0-b6ac-7a6fa2ca0197 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1789310 Nov 24 16:22:59.389003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:22:59.404680 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Checking segment: {'id': '786919d5-864e-4e4c-b4e6-07e0d18de950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'a89698c0-50df-47c7-8ceb-e514cf9ec567'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:22:59.407124 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Network hostable DHCP agents. Network: a89698c0-50df-47c7-8ceb-e514cf9ec567, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:22:59.498061 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e52c38d3-6148-4615-a501-01bc7e7788f0 req-1505da63-eca2-4464-9f54-d281b6cae468 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1614010 Nov 24 16:22:59.510593 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4b18b6-ed79-47bb-a27e-fe2b6d4d599c req-8839b548-4794-4f1d-84bd-17f50970489a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.512287 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f4b18b6-ed79-47bb-a27e-fe2b6d4d599c req-8839b548-4794-4f1d-84bd-17f50970489a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0469511 Nov 24 16:22:59.548606 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Network a89698c0-50df-47c7-8ceb-e514cf9ec567 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:22:59.574409 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f4b18b6-ed79-47bb-a27e-fe2b6d4d599c req-4f536ebf-e266-4e7b-be76-392cf208f8d6 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495613 Nov 24 16:22:59.652504 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, a89698c0-50df-47c7-8ceb-e514cf9ec567) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:22:59.659615 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.660060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60650719-df40-4c9f-948c-3415b005ae3d req-4a4ef026-aa4d-4eb1-adcf-07aac48c4790 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.660221 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:22:59.661599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60650719-df40-4c9f-948c-3415b005ae3d req-4a4ef026-aa4d-4eb1-adcf-07aac48c4790 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 944 time: 0.0578027 Nov 24 16:22:59.671565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d72dc36-2237-409f-8e6a-04fc13bcd9c6 None None] Network a89698c0-50df-47c7-8ceb-e514cf9ec567 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:22:59.683459 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef40f205-97d8-473c-a802-0c78a40b3dc9 req-905abd76-6699-4266-9060-55c29db56c31 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:22:59.685156 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ef40f205-97d8-473c-a802-0c78a40b3dc9 req-905abd76-6699-4266-9060-55c29db56c31 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 945 time: 0.0843787 Nov 24 16:22:59.723555 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60650719-df40-4c9f-948c-3415b005ae3d req-b3d04132-f16d-4cda-b9eb-87ed5070f32f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489202 Nov 24 16:22:59.747130 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ef40f205-97d8-473c-a802-0c78a40b3dc9 req-df547077-3b73-470e-9023-a6a256b1af74 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548980 Nov 24 16:22:59.791936 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4384d17e-fc3f-47a0-8a8f-bcf313f0aae3 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.9757378 Nov 24 16:22:59.809435 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-146db5da-5bd9-4ffd-b3e2-956eca1ee6ad None None] Network a89698c0-50df-47c7-8ceb-e514cf9ec567 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:23:00.402701 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4d8f106b-a419-4d0a-974c-73ecb7118880 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:23:00.406728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:23:00.513869 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477780e7-a9ff-449b-b22d-b5a8284e7378 req-cdca53a8-327f-4eca-83ca-3a0e9237b0ee tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:00.515709 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-477780e7-a9ff-449b-b22d-b5a8284e7378 req-cdca53a8-327f-4eca-83ca-3a0e9237b0ee tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0487583 Nov 24 16:23:00.557394 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4d8f106b-a419-4d0a-974c-73ecb7118880,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:00.566148 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-477780e7-a9ff-449b-b22d-b5a8284e7378 req-4a33ca9f-7502-4b54-8214-49406a7a2cc8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434084 Nov 24 16:23:00.571165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '4d8f106b-a419-4d0a-974c-73ecb7118880', 'network_id': 'ca445c7d-56e8-4fcf-9c97-685da788b26d', 'port_id': '4d8f106b-a419-4d0a-974c-73ecb7118880', 'mac_address': 'fa:16:3e:ad:e4:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 888, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11e98a82-ac30-426e-b0e8-ea5835b78bca', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:23:00.610002 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:00.622421 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4d8f106b-a419-4d0a-974c-73ecb7118880 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:23:00.641720 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4d8f106b-a419-4d0a-974c-73ecb7118880,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:00.708301 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:23:00.713531 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:23:00.713900 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:00.758688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:00.759438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:23:00.878370 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a66018-7903-41b8-ab7b-bb6a929f9a83 req-08b497ae-1b40-4397-9c22-93f46610c44d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:00.887878 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a7a66018-7903-41b8-ab7b-bb6a929f9a83 req-08b497ae-1b40-4397-9c22-93f46610c44d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 945 time: 0.0632918 Nov 24 16:23:00.922588 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:00.944538 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:00.975187 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a7a66018-7903-41b8-ab7b-bb6a929f9a83 req-e0c204b2-639e-4d3d-8df9-9e650c828e6b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885260 Nov 24 16:23:00.987326 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:01.003149 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:23:01.005777 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:01.046563 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:01.061369 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:23:01.074470 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:01.087509 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:01.089199 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ea3bbd-7840-4d88-851b-a099a8fcf255 req-388e1e71-6f9b-478f-9031-b309b62d7307 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:01.090732 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c1ea3bbd-7840-4d88-851b-a099a8fcf255 req-388e1e71-6f9b-478f-9031-b309b62d7307 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 945 time: 0.0565841 Nov 24 16:23:01.133818 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:01.145580 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c1ea3bbd-7840-4d88-851b-a099a8fcf255 req-1646303c-f905-43f9-8c4d-2d174bdff425 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486600 Nov 24 16:23:01.148081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:01.175933 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:01.178217 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4668809-d37b-4752-b9a8-f7a81e5e41b9" -d '{"events": [{"server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "name": "network-vif-plugged", "status": "completed", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:01.204868 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:01.219023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-264e1da4-c954-460f-bb17-77ce00ac20f1 x-openstack-request-id: req-264e1da4-c954-460f-bb17-77ce00ac20f1 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:01.219341 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "name": "network-vif-plugged", "status": "completed", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:01.219598 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-264e1da4-c954-460f-bb17-77ce00ac20f1 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:01.219982 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'code': 200} Nov 24 16:23:01.417601 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['be934a2b-3080-4139-8519-7b3fdd48d05e'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:23:01.422033 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4d8f106b-a419-4d0a-974c-73ecb7118880'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:23:01.577040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5baa5f5-871e-404a-8700-b082d2a62b5d req-fd94652a-640f-4ba2-a2a2-aba14f896f6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:01.578810 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5baa5f5-871e-404a-8700-b082d2a62b5d req-fd94652a-640f-4ba2-a2a2-aba14f896f6d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1099 time: 0.0442929 Nov 24 16:23:01.715113 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4c79aa-5e47-4fc9-91ea-57ec3a85ca09 req-301d4bc6-89fe-4d13-b8ef-385d3d8b5200 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:01.717398 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-de4c79aa-5e47-4fc9-91ea-57ec3a85ca09 req-301d4bc6-89fe-4d13-b8ef-385d3d8b5200 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 945 time: 0.0699534 Nov 24 16:23:01.734359 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5baa5f5-871e-404a-8700-b082d2a62b5d req-d5e04a53-610a-422f-8941-c5b9ed9edba1 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0744510 Nov 24 16:23:01.776282 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-de4c79aa-5e47-4fc9-91ea-57ec3a85ca09 req-402cc2a9-3ae7-4403-a7b2-ce1fa4390be1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522079 Nov 24 16:23:02.084695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49023cb-8efb-4053-8a28-032e197f50e2 req-4c828bf0-92a2-4b79-98dc-ec46d2b794eb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:02.086755 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e49023cb-8efb-4053-8a28-032e197f50e2 req-4c828bf0-92a2-4b79-98dc-ec46d2b794eb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 945 time: 0.0492480 Nov 24 16:23:02.097797 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46394) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:02.141511 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e49023cb-8efb-4053-8a28-032e197f50e2 req-8b54d1b8-6046-4b42-9f77-3bbf3c6d23ff tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486243 Nov 24 16:23:02.225334 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-df2e5833-086b-4812-b978-dcff58fa9c6b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.290667 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44938bdf-7a8f-4c5a-8185-8db2160626e5 req-7f0dae20-6eac-466d-990e-72a9adc0b70d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:02.292192 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-44938bdf-7a8f-4c5a-8185-8db2160626e5 req-7f0dae20-6eac-466d-990e-72a9adc0b70d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0688899 Nov 24 16:23:02.362192 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-44938bdf-7a8f-4c5a-8185-8db2160626e5 req-7c4025f5-46cb-4d33-9788-a3055d32a8a5 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0636611 Nov 24 16:23:02.375065 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-df2e5833-086b-4812-b978-dcff58fa9c6b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.412698 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4d8f106b-a419-4d0a-974c-73ecb7118880 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:23:02.451134 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-df2e5833-086b-4812-b978-dcff58fa9c6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.493426 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-df2e5833-086b-4812-b978-dcff58fa9c6b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7550da408eb84adab78da14ddf86e762&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3945067 Nov 24 16:23:02.494353 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df2e5833-086b-4812-b978-dcff58fa9c6b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0eda6cde-4b4e-4426-a834-da7df9c8eec9,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:02.497781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 46412) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:02.550309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.574098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.622870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 4d8f106b-a419-4d0a-974c-73ecb7118880 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:23:02.640405 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 4d8f106b-a419-4d0a-974c-73ecb7118880 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:23:02.640864 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.754391 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.789515 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4d8f106b-a419-4d0a-974c-73ecb7118880,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:02.811453 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.818362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.818362 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0eda6cde-4b4e-4426-a834-da7df9c8eec9 HTTP/1.1" status: 204 len: 168 time: 0.3168280 Nov 24 16:23:02.833743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8872f582-283f-40e1-befe-47cd32a627ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0eda6cde-4b4e-4426-a834-da7df9c8eec9,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:02.861675 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:02.862747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:23:02.939653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f902ca3-96e7-493d-a5da-0b348c18ae75 req-882eba19-4468-444b-ac5e-d3d3b9fbb2ca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:02.941905 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4f902ca3-96e7-493d-a5da-0b348c18ae75 req-882eba19-4468-444b-ac5e-d3d3b9fbb2ca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 945 time: 0.0601792 Nov 24 16:23:02.961754 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:02.992762 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4f902ca3-96e7-493d-a5da-0b348c18ae75 req-9891ab59-54e5-497c-ab66-6cf7026756af tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441835 Nov 24 16:23:03.074436 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port be934a2b-3080-4139-8519-7b3fdd48d05e completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:23:03.078861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port be934a2b-3080-4139-8519-7b3fdd48d05e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:23:03.079348 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.120500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 46432) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:03.178060 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.221486 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880'}, {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:03.230061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ae0e4f9-7b7c-4a48-9aeb-2a71cef4ce5c" -d '{"events": [{"server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "name": "network-vif-plugged", "status": "completed", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880"}, {"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:03.234217 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:03.252114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24a6359d-96f9-476f-bac0-2cae62370767 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.285710 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.309419 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb12e902-6b6b-4f2a-a229-fe8f4102f1f2 req-c7cede7c-4fee-4057-80df-c7696101dff4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:03.311253 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fb12e902-6b6b-4f2a-a229-fe8f4102f1f2 req-c7cede7c-4fee-4057-80df-c7696101dff4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0953555 Nov 24 16:23:03.321001 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b7b2117-915f-440d-9818-af2610e4e48f x-openstack-request-id: req-4b7b2117-915f-440d-9818-af2610e4e48f {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:03.322290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "name": "network-vif-plugged", "status": "completed", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880", "code": 200}, {"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:03.322743 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-4b7b2117-915f-440d-9818-af2610e4e48f {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:03.323167 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880', 'code': 200} Nov 24 16:23:03.323428 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'code': 200} Nov 24 16:23:03.351143 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24a6359d-96f9-476f-bac0-2cae62370767 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.362465 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:03.395468 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fb12e902-6b6b-4f2a-a229-fe8f4102f1f2 req-7afac182-d587-464b-84ee-e21bd644836e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691264 Nov 24 16:23:03.462020 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24a6359d-96f9-476f-bac0-2cae62370767 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.504076 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-24a6359d-96f9-476f-bac0-2cae62370767 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6a347514e2894d999c3c5406bd861f46&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3799613 Nov 24 16:23:03.505041 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46446) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:03.521737 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fbd130-4701-4738-86b6-282b1770e208 req-1f719847-4ea8-4d60-94fb-63fc7741d32d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:03.523244 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78fbd130-4701-4738-86b6-282b1770e208 req-1f719847-4ea8-4d60-94fb-63fc7741d32d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0874481 Nov 24 16:23:03.524220 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24a6359d-96f9-476f-bac0-2cae62370767 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=beb62bbd-2f36-45a7-8663-e6f3330cd0b2,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:03.580694 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f564d530-093a-4456-b930-471191bb162e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.589765 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78fbd130-4701-4738-86b6-282b1770e208 req-ae18fd2e-91ad-4ffc-9d20-cf8068d5acc2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597155 Nov 24 16:23:03.603769 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f564d530-093a-4456-b930-471191bb162e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.705286 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649e6775-f106-4167-b92c-143b4372fef1 req-e3531c38-4a59-418b-8521-026cf0ec0f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:03.715848 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-649e6775-f106-4167-b92c-143b4372fef1 req-e3531c38-4a59-418b-8521-026cf0ec0f60 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1099 time: 0.0638459 Nov 24 16:23:03.716057 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46454) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:03.745527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af488e6a-0235-47a4-ae74-2f24305fb7e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.773641 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f564d530-093a-4456-b930-471191bb162e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.776264 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f564d530-093a-4456-b930-471191bb162e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:03.777338 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-f564d530-093a-4456-b930-471191bb162e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/beb62bbd-2f36-45a7-8663-e6f3330cd0b2 HTTP/1.1" status: 204 len: 168 time: 0.2709734 Nov 24 16:23:03.798508 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f564d530-093a-4456-b930-471191bb162e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=beb62bbd-2f36-45a7-8663-e6f3330cd0b2,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:03.807430 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd3e5df-6d34-4bf5-a562-84076257c28a req-72f36c66-3719-400a-8099-93941ea34c72 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:03.808930 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5dd3e5df-6d34-4bf5-a562-84076257c28a req-72f36c66-3719-400a-8099-93941ea34c72 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1017656 Nov 24 16:23:03.818195 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46458) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:03.824827 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'floatingip': {'port_id': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:23:03.825190 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-649e6775-f106-4167-b92c-143b4372fef1 req-93cf5e45-52c2-4e19-a3c5-55edc7aceafa service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0850887 Nov 24 16:23:03.833396 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243a0b12-14ed-4c35-ae64-ca6741ef5f97 req-55ad3096-fa57-43ac-be24-b42be96e0c3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:03.833396 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-243a0b12-14ed-4c35-ae64-ca6741ef5f97 req-55ad3096-fa57-43ac-be24-b42be96e0c3d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1099 time: 0.0998020 Nov 24 16:23:03.904698 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.013505 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af488e6a-0235-47a4-ae74-2f24305fb7e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.121577 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-243a0b12-14ed-4c35-ae64-ca6741ef5f97 req-b08dce1e-cffd-4034-88f8-66075b3aa8d8 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755365 Nov 24 16:23:04.124211 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af488e6a-0235-47a4-ae74-2f24305fb7e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.144232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89f6567-2867-4655-9a8e-6279b05d2823 req-a157ee30-7a0a-46c9-813f-56260d17559c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:04.145892 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e89f6567-2867-4655-9a8e-6279b05d2823 req-a157ee30-7a0a-46c9-813f-56260d17559c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0714161 Nov 24 16:23:04.197140 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e89f6567-2867-4655-9a8e-6279b05d2823 req-78cf3654-c39f-4b47-888c-e0f9c547a46c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446980 Nov 24 16:23:04.201013 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af488e6a-0235-47a4-ae74-2f24305fb7e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f95fe3f-83c1-4a38-9237-abab17b02a2f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:04.205440 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-af488e6a-0235-47a4-ae74-2f24305fb7e8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=176c8126fb9b4096bda5430ec8bf8a1e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4873910 Nov 24 16:23:04.209413 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46474) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:04.531856 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 46482) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:04.546108 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1bf3e628-92cc-4dc9-bd60-f99ca98403d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.582559 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.654186 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1bf3e628-92cc-4dc9-bd60-f99ca98403d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.694717 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.759745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1bf3e628-92cc-4dc9-bd60-f99ca98403d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.769878 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d1ef8d-bd26-48df-872c-dbbff496c2cf req-b45b29d9-bdc6-4ed6-831d-dc98f084a04f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:04.771500 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e2d1ef8d-bd26-48df-872c-dbbff496c2cf req-b45b29d9-bdc6-4ed6-831d-dc98f084a04f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.2202468 Nov 24 16:23:04.808341 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1bf3e628-92cc-4dc9-bd60-f99ca98403d6 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e9a87106a8164882a3cb42ab985faf11&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2750831 Nov 24 16:23:04.811052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 46488) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:04.818627 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf3e628-92cc-4dc9-bd60-f99ca98403d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8809a408-3f41-4284-8f9d-d30d7c50862a,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:04.867853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.894622 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.941812 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e2d1ef8d-bd26-48df-872c-dbbff496c2cf req-5469a944-c5ba-4ffa-84e5-f20aec667bf9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584759 Nov 24 16:23:04.972592 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.975161 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.976837 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7f95fe3f-83c1-4a38-9237-abab17b02a2f HTTP/1.1" status: 204 len: 168 time: 0.7644179 Nov 24 16:23:04.986739 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.990162 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.991420 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a563ce-c523-45c0-9241-e5b8665abc3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f95fe3f-83c1-4a38-9237-abab17b02a2f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:04.994034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:04.997594 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8809a408-3f41-4284-8f9d-d30d7c50862a HTTP/1.1" status: 204 len: 168 time: 0.1828110 Nov 24 16:23:05.009299 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d846520a-6f9f-4a74-a56b-b2c6934fecca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8809a408-3f41-4284-8f9d-d30d7c50862a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:05.050962 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:05.156964 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Floating IP bce43c38-c74a-41bb-a9e8-0064c3b81952 associated. External IP: 172.27.2.92, port: a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5. Nov 24 16:23:05.332797 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba3d99-93ce-430c-b4f7-4f1b5468579b req-708ac2a8-8667-4468-a60b-20df15937a6f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:05.333912 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfba3d99-93ce-430c-b4f7-4f1b5468579b req-708ac2a8-8667-4468-a60b-20df15937a6f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0542021 Nov 24 16:23:05.380127 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:23:05.414503 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfba3d99-93ce-430c-b4f7-4f1b5468579b req-19d89635-c06e-47f0-b404-8af71aa5a7a2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0629346 Nov 24 16:23:05.522258 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:23:05.529524 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:05.540884 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:23:05.557532 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:05.558263 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:05.568721 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-79e0a1c2-2b0a-436b-ad52-37bf905f763f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "PUT /v2.0/floatingips/bce43c38-c74a-41bb-a9e8-0064c3b81952 HTTP/1.1" status: 200 len: 991 time: 1.7493498 Nov 24 16:23:05.569276 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:05.571649 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-138ffd20-4fd2-484c-8fab-698f19e68c90" -d '{"events": [{"name": "network-changed", "server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:05.647733 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9cc7bb69-7a27-4442-8c99-7183b4d03ab6 x-openstack-request-id: req-9cc7bb69-7a27-4442-8c99-7183b4d03ab6 {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:05.648329 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:05.648406 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-9cc7bb69-7a27-4442-8c99-7183b4d03ab6 {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:05.648793 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'status': 'completed', 'code': 200} Nov 24 16:23:05.789186 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:06.067091 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b75582-4a78-408a-b929-42acb99403ad req-ad4ec5f2-69e3-4160-9fab-85d5cb168e90 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:06.068666 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5b75582-4a78-408a-b929-42acb99403ad req-ad4ec5f2-69e3-4160-9fab-85d5cb168e90 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0560133 Nov 24 16:23:06.090123 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'bce43c38-c74a-41bb-a9e8-0064c3b81952', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.92', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:c7:74:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:40Z', 'updated_at': '2021-11-24T16:23:04Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:06.121517 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:23:06.132881 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:06.133504 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:06.147481 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5b75582-4a78-408a-b929-42acb99403ad req-8b5f3dda-7893-4802-8f19-b830b244f2bb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714481 Nov 24 16:23:06.253145 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:06.494336 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'bce43c38-c74a-41bb-a9e8-0064c3b81952', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.92', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:c7:74:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:40Z', 'updated_at': '2021-11-24T16:23:04Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:06.525739 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adea74ed-4eb0-4249-891b-ca9d98d9825f None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'bce43c38-c74a-41bb-a9e8-0064c3b81952', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.92', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 128, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:c7:74:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:40Z', 'updated_at': '2021-11-24T16:23:04Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:23:06.545712 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08ef7d1-abaa-4057-b91f-4914cc00dd87 req-10f59393-ce24-4b0e-b56e-af999238991a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:06.547366 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f08ef7d1-abaa-4057-b91f-4914cc00dd87 req-10f59393-ce24-4b0e-b56e-af999238991a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0562270 Nov 24 16:23:06.601654 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f08ef7d1-abaa-4057-b91f-4914cc00dd87 req-043d7fe7-b98d-4881-b507-0318745c406d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461776 Nov 24 16:23:06.757876 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-247f7e49-dff1-4983-8691-7e2b1ae74f79 None None] New status for floating IP bce43c38-c74a-41bb-a9e8-0064c3b81952: ACTIVE {{(pid=103143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:23:06.970059 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 46582) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:07.193779 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d567fee9-120e-4c9c-abd6-b0d86b92b173 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.281410 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9775b3f7-ea43-4fa0-b44f-d6fe4b05b3c5 req-ee2902d9-ac71-403d-b1ff-b8e7ec1ff342 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:07.282863 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9775b3f7-ea43-4fa0-b44f-d6fe4b05b3c5 req-ee2902d9-ac71-403d-b1ff-b8e7ec1ff342 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0706813 Nov 24 16:23:07.326493 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d567fee9-120e-4c9c-abd6-b0d86b92b173 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.348248 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9775b3f7-ea43-4fa0-b44f-d6fe4b05b3c5 req-70039927-1777-46fc-80b6-6b81b2c815c1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583766 Nov 24 16:23:07.388037 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d567fee9-120e-4c9c-abd6-b0d86b92b173 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.428590 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d567fee9-120e-4c9c-abd6-b0d86b92b173 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3fbd10ad8e684d5daaccbd6e5fbeecb0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4547014 Nov 24 16:23:07.428590 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d567fee9-120e-4c9c-abd6-b0d86b92b173 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=def48a9c-03cf-453d-b024-419bf05a4917,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:07.430086 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46600) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:07.481265 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.506195 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.633392 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.635823 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:07.636979 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/def48a9c-03cf-453d-b024-419bf05a4917 HTTP/1.1" status: 204 len: 168 time: 0.2057750 Nov 24 16:23:07.645081 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f0ca37e-b7b4-4511-9ef2-27c70d8936f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=def48a9c-03cf-453d-b024-419bf05a4917,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:07.725164 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feae2262-115d-45bc-a1ba-a550be95acd4 req-e33746d2-e99e-4207-afa7-a2364ddd79b3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:07.727277 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-feae2262-115d-45bc-a1ba-a550be95acd4 req-e33746d2-e99e-4207-afa7-a2364ddd79b3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0518351 Nov 24 16:23:07.968832 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-feae2262-115d-45bc-a1ba-a550be95acd4 req-f727b68a-bdcc-4873-af41-5c1a578e1298 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2356064 Nov 24 16:23:08.236688 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-92105f1f-05ae-4791-a1dc-787ad667d510 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:08.238079 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-92105f1f-05ae-4791-a1dc-787ad667d510 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1099 time: 0.0404749 Nov 24 16:23:08.338030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-7f635984-e936-42cd-b65a-6fb9b43d9e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:08.339523 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-7f635984-e936-42cd-b65a-6fb9b43d9e70 service neutron] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 911 time: 0.0868695 Nov 24 16:23:08.486328 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-52590f03-a46c-4fc0-b498-08bb9aa05de5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 1001 time: 0.1242681 Nov 24 16:23:08.504164 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fd3f8f-9ab4-444b-9b4a-2fd6da3cabd3 req-f9f74c32-5f5e-424a-a6bd-def33c137cb8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:08.506000 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58fd3f8f-9ab4-444b-9b4a-2fd6da3cabd3 req-f9f74c32-5f5e-424a-a6bd-def33c137cb8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0832014 Nov 24 16:23:08.584176 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-f9d65363-3715-4b9e-87ff-d229795d0d37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:08.586209 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-f9d65363-3715-4b9e-87ff-d229795d0d37 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.0754113 Nov 24 16:23:08.589955 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58fd3f8f-9ab4-444b-9b4a-2fd6da3cabd3 req-a4521c9f-14dc-43ea-876a-2cc57eecaf03 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780015 Nov 24 16:23:08.637784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-7c2806ed-b6bc-4cfc-a7b3-554d7aa557c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:08.639305 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-7c2806ed-b6bc-4cfc-a7b3-554d7aa557c3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409615 Nov 24 16:23:08.743242 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-7d8649d7-7d86-4bd1-9677-b34f00a38840 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867252 Nov 24 16:23:09.089058 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0dbe77b-7951-4153-8485-6eef396852fc req-76f6fd97-2869-404d-ac95-c2d14336f9fe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:09.090530 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b0dbe77b-7951-4153-8485-6eef396852fc req-76f6fd97-2869-404d-ac95-c2d14336f9fe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0479271 Nov 24 16:23:09.139188 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b0dbe77b-7951-4153-8485-6eef396852fc req-67183bb8-1f62-44fe-9466-1fb0fa70ad81 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427198 Nov 24 16:23:09.254625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e48d4cd-f507-4db7-a383-a9a18ab52a52 req-480c9dbc-4cf4-4996-9c8e-4fe7691d0668 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:09.256075 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9e48d4cd-f507-4db7-a383-a9a18ab52a52 req-480c9dbc-4cf4-4996-9c8e-4fe7691d0668 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0478864 Nov 24 16:23:09.265536 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 46654) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:09.270334 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'floatingip': {'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:23:09.311467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:09.710375 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4361ffeb-b9b3-49e9-8696-4edb1d80987f req-87337bd5-316c-4901-b290-ab0a01ce2ff1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:09.711989 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4361ffeb-b9b3-49e9-8696-4edb1d80987f req-87337bd5-316c-4901-b290-ab0a01ce2ff1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0548406 Nov 24 16:23:09.768927 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4361ffeb-b9b3-49e9-8696-4edb1d80987f req-bd7c9512-2f71-44f3-afd8-58163d82a8f1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503211 Nov 24 16:23:09.775356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:09.845291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:09.946098 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Floating IP 31e6eff1-5214-42c6-996e-f177308316bd associated. External IP: 172.27.2.100, port: be934a2b-3080-4139-8519-7b3fdd48d05e. Nov 24 16:23:10.322482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:23:10.425533 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:23:10.431059 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:10.438004 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:23:10.450035 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:10.450643 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:10.463573 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-86a5af14-4773-4a4a-b700-edcc32e6e501 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "PUT /v2.0/floatingips/31e6eff1-5214-42c6-996e-f177308316bd HTTP/1.1" status: 200 len: 992 time: 1.1942613 Nov 24 16:23:10.463573 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:10.469189 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9eca9783-1759-499d-afa8-130eefb64666" -d '{"events": [{"name": "network-changed", "server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:10.685266 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:10.910396 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '31e6eff1-5214-42c6-996e-f177308316bd', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.100', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 125, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ede480a-9913-493f-bedc-9103638bc19b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:37Z', 'updated_at': '2021-11-24T16:23:09Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:10.936701 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:23:10.945574 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:23:10.946245 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:22:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:11.047952 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:23:11.272393 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '31e6eff1-5214-42c6-996e-f177308316bd', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.100', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 125, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ede480a-9913-493f-bedc-9103638bc19b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:37Z', 'updated_at': '2021-11-24T16:23:09Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:11.301706 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3713da5a-58bd-4698-8a3a-d4f8b1a8d2ca None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '31e6eff1-5214-42c6-996e-f177308316bd', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.100', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 125, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ede480a-9913-493f-bedc-9103638bc19b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:22:37Z', 'updated_at': '2021-11-24T16:23:09Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:23:11.478373 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43e1f61e-55f9-4775-840f-1d5739f59fb5 None None] New status for floating IP 31e6eff1-5214-42c6-996e-f177308316bd: ACTIVE {{(pid=103143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:23:12.144170 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d35f4c8-ec69-4a33-9143-cb9a5d61b2ea x-openstack-request-id: req-9d35f4c8-ec69-4a33-9143-cb9a5d61b2ea {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:12.145010 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:12.145276 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-9d35f4c8-ec69-4a33-9143-cb9a5d61b2ea {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:12.145681 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'status': 'completed', 'code': 200} Nov 24 16:23:12.157700 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-138ffd20-4fd2-484c-8fab-698f19e68c90 req-fd594001-fd5e-465b-a46b-b680fd05d6be service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0986018 Nov 24 16:23:12.254162 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eca9783-1759-499d-afa8-130eefb64666 req-08957319-cd8a-4c12-bec5-689918455a27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:12.255718 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-08957319-cd8a-4c12-bec5-689918455a27 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1099 time: 0.0753024 Nov 24 16:23:12.263673 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46809066-c6eb-472d-9295-492cae8d909d req-05a7ae10-8fe9-4dff-99cd-6c1bee90eb14 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:12.265068 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-46809066-c6eb-472d-9295-492cae8d909d req-05a7ae10-8fe9-4dff-99cd-6c1bee90eb14 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0763793 Nov 24 16:23:12.373125 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-46809066-c6eb-472d-9295-492cae8d909d req-726ba3aa-f7fe-4672-9e2b-d669e5a4e284 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979052 Nov 24 16:23:12.389578 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eca9783-1759-499d-afa8-130eefb64666 req-2c6ca963-f7e3-458a-8a4e-cdda2d3eccde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:12.391243 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-2c6ca963-f7e3-458a-8a4e-cdda2d3eccde service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.1252840 Nov 24 16:23:12.471811 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-3f0b4749-caf1-49a3-98f9-f2aba311b6f6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 1002 time: 0.0602744 Nov 24 16:23:12.532233 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eca9783-1759-499d-afa8-130eefb64666 req-c9f14494-8a3a-41df-988d-4f3e43b56cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:12.533712 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-c9f14494-8a3a-41df-988d-4f3e43b56cbe service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0476046 Nov 24 16:23:12.593718 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eca9783-1759-499d-afa8-130eefb64666 req-2e693a1d-dbb1-4b4b-b15e-095699e0c74d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:12.595228 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-2e693a1d-dbb1-4b4b-b15e-095699e0c74d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0446587 Nov 24 16:23:12.686696 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-133580d4-8598-4602-a4b0-299ce4fd2422 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823774 Nov 24 16:23:12.794387 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9eca9783-1759-499d-afa8-130eefb64666 req-23b3a3e7-3b6f-4a3a-829f-a4027a4a11b9 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899754 Nov 24 16:23:13.494789 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68bb510d-151d-4bf1-b7a8-816b747437c1 req-764862d4-6082-4fcd-8b92-21bf6d1cc5ff tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:13.497368 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68bb510d-151d-4bf1-b7a8-816b747437c1 req-764862d4-6082-4fcd-8b92-21bf6d1cc5ff tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0518768 Nov 24 16:23:13.549081 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68bb510d-151d-4bf1-b7a8-816b747437c1 req-58f04d6b-45aa-40d7-9f3b-713352dfbc8f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457528 Nov 24 16:23:13.765935 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-a2aa15b8-1cee-441b-a571-e1135549bc88 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/networks?tenant_id=ca0360dfada54abab247f755bc90682d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0287962 Nov 24 16:23:13.972659 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-3137bc91-a57e-4fa7-be55-2d19b2e56d3a tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:13.974199 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-3137bc91-a57e-4fa7-be55-2d19b2e56d3a tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2028792 Nov 24 16:23:13.994433 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-6c1ad91f-fa24-49a3-8507-56fb254c2104 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/quotas/ca0360dfada54abab247f755bc90682d HTTP/1.1" status: 200 len: 375 time: 0.0126600 Nov 24 16:23:14.013714 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7cd0c3-1088-4235-af3f-449151328658 req-718823d0-2dba-4863-aa0d-98036753b313 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:14.015846 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a7cd0c3-1088-4235-af3f-449151328658 req-718823d0-2dba-4863-aa0d-98036753b313 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0679488 Nov 24 16:23:14.033951 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-87cab3d1-2a50-4edb-aa0e-d29607b68057 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=ca0360dfada54abab247f755bc90682d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0315428 Nov 24 16:23:14.117854 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-b4dfcde6-0f07-46a2-a28a-6a09d4caf749 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:14.119486 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-b4dfcde6-0f07-46a2-a28a-6a09d4caf749 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1099 time: 0.0743306 Nov 24 16:23:14.127625 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a7cd0c3-1088-4235-af3f-449151328658 req-7ce4a641-d2f1-4d20-94e6-e1dfe51a287c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996711 Nov 24 16:23:14.237431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-aa212a9f-88bb-41c1-8982-6fc3872c8cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:14.238934 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-aa212a9f-88bb-41c1-8982-6fc3872c8cc6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.1104164 Nov 24 16:23:14.325790 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-20151e88-bf8b-43da-bd82-1325f50492c7 req-e28a7642-70ff-476a-aa72-3c1628ba91fa tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0534465 Nov 24 16:23:14.327067 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-59549d0f-997d-47bf-ab58-69429100f5ec service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 200 len: 217 time: 0.0742438 Nov 24 16:23:14.409034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-deed93ca-78cc-4930-9eb7-5441bbc33d43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:14.411379 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-deed93ca-78cc-4930-9eb7-5441bbc33d43 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0747037 Nov 24 16:23:14.455137 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-beec4580-8a0e-4296-9a47-6ae9b7030d1a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0318892 Nov 24 16:23:14.568197 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-149d3222-92bb-4e27-872d-fc34641020f3 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0985267 Nov 24 16:23:14.660975 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c7718bed-fe91-4205-98ae-f0111ed0c947 req-b1ddb297-e648-4897-b37e-71078b00670c service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858247 Nov 24 16:23:14.817667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0074a198-2b0e-44cf-89c8-c62fb5e96af2 req-aca878f1-9a2a-4b99-974b-dc51ebf4816d tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:14.819717 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0074a198-2b0e-44cf-89c8-c62fb5e96af2 req-aca878f1-9a2a-4b99-974b-dc51ebf4816d tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0495970 Nov 24 16:23:14.870417 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0074a198-2b0e-44cf-89c8-c62fb5e96af2 req-029dc63d-32db-42f7-8331-3bcd920c82ea tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447712 Nov 24 16:23:15.269633 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d290f1f7-ef81-4998-a100-56cc29f1a36f req-44d59d9b-7d55-481e-91e4-94eaa6cbc7d5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:15.271157 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d290f1f7-ef81-4998-a100-56cc29f1a36f req-44d59d9b-7d55-481e-91e4-94eaa6cbc7d5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0513842 Nov 24 16:23:15.317472 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d290f1f7-ef81-4998-a100-56cc29f1a36f req-33c8e583-b756-435b-b295-be77a73281d5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404224 Nov 24 16:23:15.400226 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a67d6ae-2eb7-49b5-97d2-0eec5dfe2d83 req-01d82da1-1e83-4b65-a876-abd1edd1ef86 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0259309 Nov 24 16:23:16.914033 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e16ae655-2406-49f6-b71b-3890d425f8fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:18.475678 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e64241-a790-42b2-8d9d-5792899f4b9d req-0b812c11-a1d5-481f-a3ed-1a5a27172f67 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:18.477161 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d3e64241-a790-42b2-8d9d-5792899f4b9d req-0b812c11-a1d5-481f-a3ed-1a5a27172f67 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0494277 Nov 24 16:23:18.495747 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da17155f-d1ae-4172-8b15-accefdb159f3 req-bcd09d21-b172-4a4a-966a-8c0ebea03534 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:18.497489 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-da17155f-d1ae-4172-8b15-accefdb159f3 req-bcd09d21-b172-4a4a-966a-8c0ebea03534 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0485024 Nov 24 16:23:18.527890 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d3e64241-a790-42b2-8d9d-5792899f4b9d req-61bc9892-4f17-4e05-a2a3-bb7864fbcb25 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444660 Nov 24 16:23:18.547792 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-da17155f-d1ae-4172-8b15-accefdb159f3 req-5c829c93-8de4-474b-9a7c-878c8e39df61 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435975 Nov 24 16:23:18.610240 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-51cfd002-3478-4bd2-8fc3-90967a9bd404 req-161ae917-9d2e-4ea1-9f43-6b1402639425 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0253050 Nov 24 16:23:19.239080 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0e112014-c503-475a-a5f4-6ae3211a3ed2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:19.654653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98a9d43-8914-4fd7-9272-26b099cf5ec4 req-51f25617-d395-46c4-a89c-c8d5c48f4356 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:19.656237 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d98a9d43-8914-4fd7-9272-26b099cf5ec4 req-51f25617-d395-46c4-a89c-c8d5c48f4356 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0496514 Nov 24 16:23:19.673658 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0f8476-5a19-4206-ab58-8283a6ed607e req-24716e08-1abd-46fb-9b9d-989d723b8e31 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:19.680960 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a0f8476-5a19-4206-ab58-8283a6ed607e req-24716e08-1abd-46fb-9b9d-989d723b8e31 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0538990 Nov 24 16:23:19.714411 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d98a9d43-8914-4fd7-9272-26b099cf5ec4 req-5a2d8751-e091-4af1-b9f3-41393d3e7bc7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465555 Nov 24 16:23:19.723490 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a0f8476-5a19-4206-ab58-8283a6ed607e req-55f260e7-90b5-4cf1-bcaa-b187dc3e3a9b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416076 Nov 24 16:23:19.799313 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-e1aff428-53ac-4ab6-a06b-93bb06c55cdc tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.84 "GET /v2.0/networks?tenant_id=ca0360dfada54abab247f755bc90682d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0405788 Nov 24 16:23:19.815752 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a664c236-e0e5-4e3c-940e-a5a30258845e req-888d2ea5-0240-4eb7-9c59-65e521d7f5da tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0363700 Nov 24 16:23:19.994224 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-3ec4b57b-0759-4090-ab0f-55b9c5424e8e tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:19.995775 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-3ec4b57b-0759-4090-ab0f-55b9c5424e8e tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1825175 Nov 24 16:23:20.014492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Request body: {'port': {'device_id': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'network_id': '17fdd946-070b-480a-a561-ab90afd11264', 'admin_state_up': True, 'tenant_id': 'ca0360dfada54abab247f755bc90682d'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:23:20.199449 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Made reservation on behalf of ca0360dfada54abab247f755bc90682d for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:23:20.203240 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:20.212872 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:20.288658 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:20.352864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-4f6fbabe-9b53-4345-8ebe-29a8d18a60ab tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:20.354304 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-4f6fbabe-9b53-4345-8ebe-29a8d18a60ab tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.84 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0472708 Nov 24 16:23:20.359619 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:20.397144 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:20.757887 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c632df7c-3635-4625-9319-7ce3a6388b26,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:20.792323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.793044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.793384 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.793782 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.794120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.794487 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.794784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.795169 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.795459 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.795790 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.796117 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.796437 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:20.891106 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc8d97f-a6c0-4beb-84e9-19af5cbf9c08 req-0c05c0c3-b70d-4704-a302-7a61959ec28a tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:20.892643 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6fc8d97f-a6c0-4beb-84e9-19af5cbf9c08 req-0c05c0c3-b70d-4704-a302-7a61959ec28a tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 945 time: 0.0636833 Nov 24 16:23:20.942531 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Allocated IP 192.168.233.38 (17fdd946-070b-480a-a561-ab90afd11264/c8138b94-2584-4be5-8397-7f3201869580/f63ca65c-d50b-4e88-8453-832022ad1f33) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:23:20.947301 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6fc8d97f-a6c0-4beb-84e9-19af5cbf9c08 req-6c8359f9-0ac3-4287-a7b2-20e72969f18e tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/security-groups?id=6c91b838-9c8e-468a-8313-54a782bc511c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471232 Nov 24 16:23:20.976372 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Deleting port 564f023d-54aa-4048-a3af-1322467f81e9 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:23:20.976719 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.007099 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13d189a-01b1-493f-b938-8f53474fba10 req-56a86aef-6177-4c49-b29f-5b8225f12ee2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:21.008980 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e13d189a-01b1-493f-b938-8f53474fba10 req-56a86aef-6177-4c49-b29f-5b8225f12ee2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.1691368 Nov 24 16:23:21.067933 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f923b921-9391-427c-9980-b1ee32e4c693 req-ea0fc0b2-212d-48dc-b57c-aecba9a1d2aa tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0338016 Nov 24 16:23:21.215685 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e13d189a-01b1-493f-b938-8f53474fba10 req-9c8e7723-ad13-47d4-93c8-b8d13486f8a4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1995466 Nov 24 16:23:21.217538 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] For port 564f023d-54aa-4048-a3af-1322467f81e9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=564f023d-54aa-4048-a3af-1322467f81e9,segment=NetworkSegment(3447941d-e796-4606-b805-9a893e2dd7cb),segment_id=3447941d-e796-4606-b805-9a893e2dd7cb)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:21.217934 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.278212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Calling delete_port for 564f023d-54aa-4048-a3af-1322467f81e9 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:23:21.398488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.576860 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.624234 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Network 17fdd946-070b-480a-a561-ab90afd11264 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:23:21.626711 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:23:21.636189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:23:21.643743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:21.643743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.659189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.672424 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['564f023d-54aa-4048-a3af-1322467f81e9'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:23:21.676904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Pushing event updated for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:21.720250 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.763005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Pushing event deleted for resources: {'Port': ['ID=564f023d-54aa-4048-a3af-1322467f81e9,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:21.768648 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-8389fa4d-fde2-4317-9bd7-c6248dcfbe19 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.7588825 Nov 24 16:23:21.789670 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] No DVR routers for this DVR port 564f023d-54aa-4048-a3af-1322467f81e9 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:23:21.794122 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Request body: {'port': {'device_id': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:23:21.798746 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.802301 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4ad1ef7c-e7ac-43c1-8ed4-3f0dc6b1d89e req-124a91c2-c812-4f40-ac5a-ee9e178a1ce7 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.84 "DELETE /v2.0/ports/564f023d-54aa-4048-a3af-1322467f81e9 HTTP/1.1" status: 204 len: 173 time: 1.4296093 Nov 24 16:23:21.802762 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'name': 'network-vif-deleted', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:21.805098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-717d6a3a-707d-43c6-932d-8117c55f2415" -d '{"events": [{"server_uuid": "d210a764-7424-422d-9801-74723813c79f", "name": "network-vif-deleted", "tag": "564f023d-54aa-4048-a3af-1322467f81e9"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:21.867466 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4814717-cf94-4297-9706-f1a6fda65fdc x-openstack-request-id: req-a4814717-cf94-4297-9706-f1a6fda65fdc {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:21.867757 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d210a764-7424-422d-9801-74723813c79f", "name": "network-vif-deleted", "tag": "564f023d-54aa-4048-a3af-1322467f81e9", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:21.868182 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a4814717-cf94-4297-9706-f1a6fda65fdc {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:21.868599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd210a764-7424-422d-9801-74723813c79f', 'name': 'network-vif-deleted', 'tag': '564f023d-54aa-4048-a3af-1322467f81e9', 'status': 'completed', 'code': 200} Nov 24 16:23:21.885061 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:21.955312 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-006660b4-ebf2-4b9f-baee-d29f732812dc None None] Provisioning complete for port f63ca65c-d50b-4e88-8453-832022ad1f33 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:23:21.955312 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-006660b4-ebf2-4b9f-baee-d29f732812dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.007331 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-006660b4-ebf2-4b9f-baee-d29f732812dc None None] Port f63ca65c-d50b-4e88-8453-832022ad1f33 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:23:22.105447 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-51317283-8472-413f-a4a7-691d8e26fb92 req-72381241-7949-4e59-aab5-f097e4806224 tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.0362282 Nov 24 16:23:22.197246 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aad267c-1cfd-448b-ae14-f5a2e1970193 req-1a5d0058-0646-4840-bec3-8bf353256ce4 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:22.199736 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6aad267c-1cfd-448b-ae14-f5a2e1970193 req-1a5d0058-0646-4840-bec3-8bf353256ce4 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 935 time: 0.0490522 Nov 24 16:23:22.236642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f63ca65c-d50b-4e88-8453-832022ad1f33 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:23:22.246078 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.259885 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Transition to ACTIVE for port object f63ca65c-d50b-4e88-8453-832022ad1f33 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:23:22.261264 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6aad267c-1cfd-448b-ae14-f5a2e1970193 req-69ec745a-1b5b-4cf2-b453-90c0dbafe9a8 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544007 Nov 24 16:23:22.348196 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559964a7-6dcb-4de3-b16b-b043c899fa55 req-15c50ac9-3dc6-4a5a-8743-39065d5d6897 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:22.349707 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-559964a7-6dcb-4de3-b16b-b043c899fa55 req-15c50ac9-3dc6-4a5a-8743-39065d5d6897 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0596747 Nov 24 16:23:22.363663 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.446943 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Pushing event updated for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:22.458048 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-559964a7-6dcb-4de3-b16b-b043c899fa55 req-2331d866-95c4-4781-a0d9-e08ce31dff1a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014223 Nov 24 16:23:22.468639 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.494295 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Attempting to bind port f63ca65c-d50b-4e88-8453-832022ad1f33 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:23:22.494637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Attempting to bind port f63ca65c-d50b-4e88-8453-832022ad1f33 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:23:22.495065 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Attempting to bind port f63ca65c-d50b-4e88-8453-832022ad1f33 on network 17fdd946-070b-480a-a561-ab90afd11264 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:23:22.499644 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Port f63ca65c-d50b-4e88-8453-832022ad1f33 on network 17fdd946-070b-480a-a561-ab90afd11264 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:23:22.501487 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Attempting to bind port f63ca65c-d50b-4e88-8453-832022ad1f33 on network 17fdd946-070b-480a-a561-ab90afd11264 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:23:22.505302 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 22, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:23:22.505726 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Checking segment: {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:23:22.506185 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Bound using segment: {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:23:22.506812 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Bound port: f63ca65c-d50b-4e88-8453-832022ad1f33, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5dbcf00b-55c9-460c-99de-d8b326c48163', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '17fdd946-070b-480a-a561-ab90afd11264'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:23:22.507193 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.583964 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:23:22.588320 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f63ca65c-d50b-4e88-8453-832022ad1f33,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:23:22.725275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.762014 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:22.762660 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:22.764076 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] 10.222.0.84 "PUT /v2.0/ports/f63ca65c-d50b-4e88-8453-832022ad1f33 HTTP/1.1" status: 200 len: 1097 time: 0.9757662 Nov 24 16:23:22.791367 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99cf76cd-5ce4-4bc3-aceb-92456badaafe service neutron] Pushing event updated for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:22.990144 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-a8a470aa-5a26-40a8-b515-deb07c3d9b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:22.991740 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-a8a470aa-5a26-40a8-b515-deb07c3d9b96 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ca0360dfada54abab247f755bc90682d&device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 1100 time: 0.0419290 Nov 24 16:23:23.043735 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-f3e22e33-0203-4ac3-ba50-159de21677c3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=f63ca65c-d50b-4e88-8453-832022ad1f33 HTTP/1.1" status: 200 len: 217 time: 0.0375528 Nov 24 16:23:23.099818 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-4ba6c92e-16aa-4e65-bcda-d27981d484a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.101233 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-4ba6c92e-16aa-4e65-bcda-d27981d484a4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c8138b94-2584-4be5-8397-7f3201869580 HTTP/1.1" status: 200 len: 843 time: 0.0442295 Nov 24 16:23:23.158788 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-540c0c59-d700-480b-a13d-5468dfeccf12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.160380 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-540c0c59-d700-480b-a13d-5468dfeccf12 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=17fdd946-070b-480a-a561-ab90afd11264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0445211 Nov 24 16:23:23.275020 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9c16dbde-7db7-470c-be75-6e31e9caf5bc req-90dda5e0-3365-412c-a287-8a9ef69c8eca tempest-DeleteServersTestJSON-890817297 tempest-DeleteServersTestJSON-890817297-project] 10.222.0.82 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.0346289 Nov 24 16:23:23.323525 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-77bf5811-c0e6-4e81-af0f-7aec6c445a31 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=d210a764-7424-422d-9801-74723813c79f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0287240 Nov 24 16:23:23.325406 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-bc66c3a9-2bff-449c-9609-504273f7c03b service neutron] 10.222.0.84 "GET /v2.0/networks/17fdd946-070b-480a-a561-ab90afd11264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1549461 Nov 24 16:23:23.385041 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da22ce3-e408-4632-9620-d84fd4a2bab3 req-276f0409-6a0f-49b1-baf1-6eb47844cfbe tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.386538 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0da22ce3-e408-4632-9620-d84fd4a2bab3 req-276f0409-6a0f-49b1-baf1-6eb47844cfbe tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 947 time: 0.0491335 Nov 24 16:23:23.413539 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-d61f30cc-7f70-4bd5-ac44-2dd5e4cf6e0d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&device_id=d210a764-7424-422d-9801-74723813c79f HTTP/1.1" status: 200 len: 210 time: 0.0400298 Nov 24 16:23:23.459375 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0da22ce3-e408-4632-9620-d84fd4a2bab3 req-83e245f6-68f2-40bf-b26a-aa3cf4790c51 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666177 Nov 24 16:23:23.597898 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fcc37739-1eaa-4c56-a2bb-ffa9a69c9772 req-097991bb-a2cc-42b0-b453-694495f93fe9 service neutron] 10.222.0.84 "GET /v2.0/networks/17fdd946-070b-480a-a561-ab90afd11264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2493727 Nov 24 16:23:23.674725 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-6ac2ec30-bea4-44a4-851c-0e18c8ac3025 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.674725 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-6ac2ec30-bea4-44a4-851c-0e18c8ac3025 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2212982 Nov 24 16:23:23.684841 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b93f396-4421-40a4-9165-e09498ef9f88 req-37d33fbe-2bf7-47bc-b6f5-12b16678c1cf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.686321 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2b93f396-4421-40a4-9165-e09498ef9f88 req-37d33fbe-2bf7-47bc-b6f5-12b16678c1cf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.1158390 Nov 24 16:23:23.857557 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2b93f396-4421-40a4-9165-e09498ef9f88 req-1beb5db6-febb-4586-8822-ba852b1d19c7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1623724 Nov 24 16:23:23.870956 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:23.873259 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e322f493-5221-44c0-9989-c302e039b283" -d '{"events": [{"name": "network-changed", "server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:23.885830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-76509756-cdd6-4045-a666-5a60d313725f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:23.887325 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1084529d-6565-4e4f-bbab-b3d245da25f1 req-76509756-cdd6-4045-a666-5a60d313725f service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2001514 Nov 24 16:23:23.914270 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-310b68e7-94e0-4b02-b9dd-1df7a7a396b8 x-openstack-request-id: req-310b68e7-94e0-4b02-b9dd-1df7a7a396b8 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:23.914572 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:23.914834 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-310b68e7-94e0-4b02-b9dd-1df7a7a396b8 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:23.915267 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33', 'status': 'completed', 'code': 200} Nov 24 16:23:24.008187 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e322f493-5221-44c0-9989-c302e039b283 req-31d1de45-109e-4cca-8687-391e0bfcdc97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.009690 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-31d1de45-109e-4cca-8687-391e0bfcdc97 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=ca0360dfada54abab247f755bc90682d&device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 1100 time: 0.0449221 Nov 24 16:23:24.316316 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e322f493-5221-44c0-9989-c302e039b283 req-fcf65b77-d24f-4f91-a6ca-cdf69d132ff5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.318284 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-fcf65b77-d24f-4f91-a6ca-cdf69d132ff5 service neutron] 10.222.0.84 "GET /v2.0/networks?id=17fdd946-070b-480a-a561-ab90afd11264 HTTP/1.1" status: 200 len: 870 time: 0.2913492 Nov 24 16:23:24.371544 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-1e7c7042-e4b5-43dc-9711-47eb6481c0d9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=f63ca65c-d50b-4e88-8453-832022ad1f33 HTTP/1.1" status: 200 len: 217 time: 0.0384626 Nov 24 16:23:24.425505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e322f493-5221-44c0-9989-c302e039b283 req-9ab81ba9-5455-4222-952c-6e0fb8b39a36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.427170 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-9ab81ba9-5455-4222-952c-6e0fb8b39a36 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=c8138b94-2584-4be5-8397-7f3201869580 HTTP/1.1" status: 200 len: 843 time: 0.0462177 Nov 24 16:23:24.483847 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e322f493-5221-44c0-9989-c302e039b283 req-819f95df-be77-4b3a-a6af-4b2b83e53696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.485250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-819f95df-be77-4b3a-a6af-4b2b83e53696 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=17fdd946-070b-480a-a561-ab90afd11264&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0433841 Nov 24 16:23:24.570830 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 564f023d-54aa-4048-a3af-1322467f81e9 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:23:24.596445 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 564f023d-54aa-4048-a3af-1322467f81e9 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:23:24.596792 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 564f023d-54aa-4048-a3af-1322467f81e9 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:23:24.622526 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-572a0850-a573-4062-9d8a-62f9d0805f31 service neutron] 10.222.0.84 "GET /v2.0/networks/17fdd946-070b-480a-a561-ab90afd11264?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272163 Nov 24 16:23:24.630773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b1103d-51a0-4d44-9994-a7b94fa927c9 req-9866e026-6323-4182-b092-1d1ba9ac43ad tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.632783 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06b1103d-51a0-4d44-9994-a7b94fa927c9 req-9866e026-6323-4182-b092-1d1ba9ac43ad tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 947 time: 0.1023667 Nov 24 16:23:24.738334 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06b1103d-51a0-4d44-9994-a7b94fa927c9 req-65c56d56-5548-441d-bf56-acfbb7ca6ce1 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959756 Nov 24 16:23:24.755699 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e322f493-5221-44c0-9989-c302e039b283 req-5cfc0844-f2f4-4a28-88e2-221f3aa2b950 service neutron] 10.222.0.84 "GET /v2.0/networks/17fdd946-070b-480a-a561-ab90afd11264?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1203465 Nov 24 16:23:24.987702 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6be09c4-4f27-4f0a-8e6f-909aef632881 req-62753353-f2c7-4f3d-b862-93a115608ccc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:24.987702 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6be09c4-4f27-4f0a-8e6f-909aef632881 req-62753353-f2c7-4f3d-b862-93a115608ccc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0567424 Nov 24 16:23:25.040274 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6be09c4-4f27-4f0a-8e6f-909aef632881 req-582dae02-50ae-45bd-ba7d-dd72152383ae tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426221 Nov 24 16:23:25.538417 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47090) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:25.648261 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:25.720690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:25.776671 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:25.813637 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=28fb1a1cc07647f9ac92e6dc08c7dc6f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2741046 Nov 24 16:23:25.815650 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35c87118-9cd2-4917-9abb-c434c3131f60,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:25.817491 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47100) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:25.822761 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.823138 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.823482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.823819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.824151 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.824482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.824819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.825144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.825489 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.825789 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.826108 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.826575 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a860ae5b-d5db-46cd-a53e-5c51c910025f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:25.896160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6307bf3e-6e35-4d8b-97d7-b4839d7214c4 req-b7e46e87-516a-4725-a5f0-4074b28dc021 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:25.898233 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6307bf3e-6e35-4d8b-97d7-b4839d7214c4 req-b7e46e87-516a-4725-a5f0-4074b28dc021 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 947 time: 0.0908055 Nov 24 16:23:25.938098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:25.977772 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47114) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:25.980172 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.000052 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6307bf3e-6e35-4d8b-97d7-b4839d7214c4 req-a3a5a245-5897-4852-a9ff-134ad332ded1 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904768 Nov 24 16:23:26.023369 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Deleting subnet 5a02c365-5301-48d1-9f84-76ef767bb61b {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:23:26.027137 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.063265 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.072967 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.131052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.134647 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.138241 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/35c87118-9cd2-4917-9abb-c434c3131f60 HTTP/1.1" status: 204 len: 168 time: 0.3162081 Nov 24 16:23:26.152699 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcbc61d-4ae5-4b9e-b08c-b50802497682 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35c87118-9cd2-4917-9abb-c434c3131f60,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:26.175307 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7508d091-172e-4b11-81cd-7d78cb252940 req-353b8212-a08f-442b-bfeb-0ca883e76eaa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:26.182883 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7508d091-172e-4b11-81cd-7d78cb252940 req-353b8212-a08f-442b-bfeb-0ca883e76eaa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0695131 Nov 24 16:23:26.235916 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7508d091-172e-4b11-81cd-7d78cb252940 req-93228fb1-c1a4-41d4-8023-bd3097d2167e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521159 Nov 24 16:23:26.244956 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.275419 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5a02c365-5301-48d1-9f84-76ef767bb61b,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:26.280754 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.286945 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-eb6b64fa-c2ee-47af-ae33-2ceb552e7f46 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5a02c365-5301-48d1-9f84-76ef767bb61b HTTP/1.1" status: 204 len: 168 time: 0.3055477 Nov 24 16:23:26.287981 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47126) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:26.357004 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.446113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.467369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.467740 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.468494 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.468854 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > port after_create 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.469202 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > port after_delete 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.469542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > port after_update 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.469866 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.470205 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.470528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.470853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.629052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.629329 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.629695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.630028 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103142) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:26.630423 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['34b3987c-1efb-43da-b25e-b29a5f9ba4cc']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:26.648819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3447941d-e796-4606-b805-9a893e2dd7cb') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:26.649121 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3447941d-e796-4606-b805-9a893e2dd7cb') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:26.664694 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.686095 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.695036 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Releasing vlan 896 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:23:26.695434 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: from cryptography.utils import int_from_bytes Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: from cryptography.utils import int_from_bytes Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:23:26.724151 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:23:26.810588 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47130) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:26.824031 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f0798560-1050-41d4-a9e4-39fccdb64b10 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.865712 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.885406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.888671 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] 10.222.0.82 "DELETE /v2.0/networks/34b3987c-1efb-43da-b25e-b29a5f9ba4cc HTTP/1.1" status: 204 len: 168 time: 0.5989103 Nov 24 16:23:26.891007 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24adae04-bc01-44d2-9c2d-43679ce3840e admin admin] Pushing event deleted for resources: {'Network': ['ID=34b3987c-1efb-43da-b25e-b29a5f9ba4cc,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:26.926789 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f0798560-1050-41d4-a9e4-39fccdb64b10 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:26.999426 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f0798560-1050-41d4-a9e4-39fccdb64b10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.036512 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f0798560-1050-41d4-a9e4-39fccdb64b10 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ca21a2d017984e20b08bd9805daae4f6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2248487 Nov 24 16:23:27.039095 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0798560-1050-41d4-a9e4-39fccdb64b10 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a01721c-beda-432c-827c-09106720639b,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:27.039727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47138) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:27.087957 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.112849 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.198817 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.201515 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.205343 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9a01721c-beda-432c-827c-09106720639b HTTP/1.1" status: 204 len: 168 time: 0.1621430 Nov 24 16:23:27.208342 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f63ca65c-d50b-4e88-8453-832022ad1f33 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:23:27.212954 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ac8d6e5-30e2-4484-91ea-41ad30f7372e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a01721c-beda-432c-827c-09106720639b,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:27.241999 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47144) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:27.287075 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d9f1d333-34a0-47a5-9f96-59ce27884d12 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4cfa849116f74a98b2398d50a2f28cd0&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0431738 Nov 24 16:23:27.291137 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47148) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:27.336974 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f63ca65c-d50b-4e88-8453-832022ad1f33,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:27.339497 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.348639 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'f63ca65c-d50b-4e88-8453-832022ad1f33', 'network_id': '17fdd946-070b-480a-a561-ab90afd11264', 'port_id': 'f63ca65c-d50b-4e88-8453-832022ad1f33', 'mac_address': 'fa:16:3e:19:d5:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 867, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c8138b94-2584-4be5-8397-7f3201869580', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:23:27.361112 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.386162 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.400804 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f63ca65c-d50b-4e88-8453-832022ad1f33 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:23:27.420174 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f63ca65c-d50b-4e88-8453-832022ad1f33,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:27.445454 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.448110 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.449353 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6c91b838-9c8e-468a-8313-54a782bc511c HTTP/1.1" status: 204 len: 168 time: 0.1572020 Nov 24 16:23:27.457252 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c15e5a-2513-4188-868b-b14fd5520051 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c91b838-9c8e-468a-8313-54a782bc511c,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:27.465081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:27.522187 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:27.529450 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.529856 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.530164 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.530506 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.530845 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.531205 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.531529 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.531861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.532215 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.532597 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.532870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:27.533268 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:23:28.162395 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:23:28.464153 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d46d4c86-7b09-4258-ab5a-c6167987c28e req-2a4257a1-3385-4168-828f-5d8451c49d70 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:28.466484 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d46d4c86-7b09-4258-ab5a-c6167987c28e req-2a4257a1-3385-4168-828f-5d8451c49d70 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 948 time: 0.0595934 Nov 24 16:23:28.512354 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6ffc23-021d-4438-a5da-df0ccbb5f2dd req-3724faab-7b19-4a30-8482-21c44033d91b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:28.515436 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-df6ffc23-021d-4438-a5da-df0ccbb5f2dd req-3724faab-7b19-4a30-8482-21c44033d91b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0713737 Nov 24 16:23:28.533976 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d46d4c86-7b09-4258-ab5a-c6167987c28e req-b3fa0eb3-5b05-4125-b76c-69bfd5daceb4 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614479 Nov 24 16:23:28.579995 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-df6ffc23-021d-4438-a5da-df0ccbb5f2dd req-1a228f72-9e50-4d41-94ad-c1abe8636adb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565412 Nov 24 16:23:28.667875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:28.701061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['f63ca65c-d50b-4e88-8453-832022ad1f33'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:23:29.528243 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47264) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:29.572685 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Deleting subnet 588053d7-4857-406f-90b0-437f057cd650 {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:23:29.575994 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.638159 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.646775 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.704246 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93218e38-bda7-4bb8-ae64-5fd32b9fad4e req-0553bb02-eaf5-4e5d-819f-5323955404e7 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:29.705648 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-93218e38-bda7-4bb8-ae64-5fd32b9fad4e req-0553bb02-eaf5-4e5d-819f-5323955404e7 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 948 time: 0.1008756 Nov 24 16:23:29.720362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7631270d-d483-4fad-ab43-0adcee907d02 req-cdb060b5-81e4-4ab2-aedc-41ba38878fcd tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:29.722105 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7631270d-d483-4fad-ab43-0adcee907d02 req-cdb060b5-81e4-4ab2-aedc-41ba38878fcd tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0598807 Nov 24 16:23:29.767794 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-93218e38-bda7-4bb8-ae64-5fd32b9fad4e req-40ea0946-dfb1-43d8-b016-660ecddaff3c tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511420 Nov 24 16:23:29.782796 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7631270d-d483-4fad-ab43-0adcee907d02 req-c3a93701-86fd-48ea-9d52-31ac2a28525a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534503 Nov 24 16:23:29.800745 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.832436 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.836255 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/588053d7-4857-406f-90b0-437f057cd650 HTTP/1.1" status: 204 len: 168 time: 0.3081312 Nov 24 16:23:29.837587 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81f6c0d-56db-4877-8266-d746e7d6af72 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=588053d7-4857-406f-90b0-437f057cd650,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:29.838857 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47278) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:29.862461 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47280) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:29.909881 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:29.993300 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.014467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.014855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.015654 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.015991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > port after_create 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.016341 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.016679 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > port after_update 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.017072 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.017413 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.017761 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.018085 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.024694 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-75e961fc-3177-4e64-a541-1205be572825 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.085910 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.086262 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.086594 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.086948 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103141) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 16:23:30.087316 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87cf40ac-4b6d-405e-ad9a-e401c70cbb37']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.097414 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-75e961fc-3177-4e64-a541-1205be572825 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.104418 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f9e0c79c-3b55-41ad-a486-7d28f60f6b38') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.104695 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f9e0c79c-3b55-41ad-a486-7d28f60f6b38') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.121069 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.141497 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.149600 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Releasing vlan 856 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:23:30.149993 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: from cryptography.utils import int_from_bytes Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: from cryptography.utils import int_from_bytes Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:23:30.153953 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:23:30.176545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-75e961fc-3177-4e64-a541-1205be572825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.218597 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-75e961fc-3177-4e64-a541-1205be572825 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1065ba054b7541a286d65538b6246a80&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3546135 Nov 24 16:23:30.219752 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e961fc-3177-4e64-a541-1205be572825 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cee632c9-e003-4dec-9759-7b0efb932a82,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:30.221467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47284) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:30.275907 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.277588 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.299608 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.302835 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] 10.222.0.82 "DELETE /v2.0/networks/87cf40ac-4b6d-405e-ad9a-e401c70cbb37 HTTP/1.1" status: 204 len: 168 time: 0.4628997 Nov 24 16:23:30.306427 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47288) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:30.306976 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-213cb53b-372f-499d-a40b-3e7690f0d3d6 admin admin] Pushing event deleted for resources: {'Network': ['ID=87cf40ac-4b6d-405e-ad9a-e401c70cbb37,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:30.316541 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.354807 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Deleting subnet 5de10e6e-9444-4d3a-932d-4fe9b84515c8 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:23:30.358028 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.392843 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.435376 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.439316 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.441938 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.443167 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cee632c9-e003-4dec-9759-7b0efb932a82 HTTP/1.1" status: 204 len: 168 time: 0.2198100 Nov 24 16:23:30.452504 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ebe4c8d-4aa8-4407-a852-31cac1805518 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cee632c9-e003-4dec-9759-7b0efb932a82,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:30.548389 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.577646 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5de10e6e-9444-4d3a-932d-4fe9b84515c8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:30.585647 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f63ca65c-d50b-4e88-8453-832022ad1f33 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:23:30.597271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.601769 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-06f73ba2-a938-4e4c-9941-bcf9e6aff4c7 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5de10e6e-9444-4d3a-932d-4fe9b84515c8 HTTP/1.1" status: 204 len: 168 time: 0.2907424 Nov 24 16:23:30.601895 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47306) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:30.695088 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.736821 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port f63ca65c-d50b-4e88-8453-832022ad1f33 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:23:30.742388 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port f63ca65c-d50b-4e88-8453-832022ad1f33 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:23:30.743029 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.782134 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.805929 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a89698c0-50df-47c7-8ceb-e514cf9ec567']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.817067 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '786919d5-864e-4e4c-b4e6-07e0d18de950') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.817614 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '786919d5-864e-4e4c-b4e6-07e0d18de950') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:23:30.828857 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.845933 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.852431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.863715 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Releasing vlan 868 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:23:30.864253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:30.876546 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:23:30.878494 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:23:30.880295 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6004d505-d96f-4fd0-95ed-bb4360e88fc9" -d '{"events": [{"server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:30.892081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f63ca65c-d50b-4e88-8453-832022ad1f33,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:30.929178 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e807486-eee1-4446-8dd3-9fdfc125276e req-01ab1afa-ff72-4089-bcc5-ba2d7800d653 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:30.930667 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7e807486-eee1-4446-8dd3-9fdfc125276e req-01ab1afa-ff72-4089-bcc5-ba2d7800d653 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 948 time: 0.0542879 Nov 24 16:23:30.965831 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b716df45-c610-4ee6-a626-2a90e3100e36 req-c6398aad-15bc-4584-9ee8-c3c908d3a310 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:30.968546 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b716df45-c610-4ee6-a626-2a90e3100e36 req-c6398aad-15bc-4584-9ee8-c3c908d3a310 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0890863 Nov 24 16:23:30.978159 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.004579 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7e807486-eee1-4446-8dd3-9fdfc125276e req-9ae91217-ed51-451d-8e06-f3ed2cd9cec5 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649984 Nov 24 16:23:31.032545 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b716df45-c610-4ee6-a626-2a90e3100e36 req-85a1bbce-4518-427f-b6d3-365381232c5d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485315 Nov 24 16:23:31.056636 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.059631 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:31.065915 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.071464 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] 10.222.0.82 "DELETE /v2.0/networks/a89698c0-50df-47c7-8ceb-e514cf9ec567 HTTP/1.1" status: 204 len: 168 time: 0.4663334 Nov 24 16:23:31.071786 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24c927c2-af1f-43ea-9259-49c4f3f69d64 x-openstack-request-id: req-24c927c2-af1f-43ea-9259-49c4f3f69d64 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:31.072901 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:31.073431 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-24c927c2-af1f-43ea-9259-49c4f3f69d64 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:31.073836 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33', 'code': 200} Nov 24 16:23:31.080340 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339f284c-17f5-4ca2-a67b-9524dd48e1df admin admin] Pushing event deleted for resources: {'Network': ['ID=a89698c0-50df-47c7-8ceb-e514cf9ec567,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:31.153183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47326) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:31.166588 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1ffc76e3-550d-4369-b59e-7c5ff88d1b1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.239526 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1ffc76e3-550d-4369-b59e-7c5ff88d1b1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.308207 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1ffc76e3-550d-4369-b59e-7c5ff88d1b1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.350268 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1ffc76e3-550d-4369-b59e-7c5ff88d1b1c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1c5b6ac569f84dc8b854543ecf4c1542&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1959963 Nov 24 16:23:31.351258 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffc76e3-550d-4369-b59e-7c5ff88d1b1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=730f73e0-b36a-42e2-bbd5-7c8a10a17659,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:31.353030 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47332) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:31.405020 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.414511 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47334) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:31.434056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab50a97-eced-4b6f-a6cc-6b9a9477a18f req-961386b4-62e3-494c-b79a-cc490bd7e626 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:31.435719 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-aab50a97-eced-4b6f-a6cc-6b9a9477a18f req-961386b4-62e3-494c-b79a-cc490bd7e626 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 1102 time: 0.0447304 Nov 24 16:23:31.440435 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.485171 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-aab50a97-eced-4b6f-a6cc-6b9a9477a18f req-36613056-414b-45e0-85ba-eb32040beaea service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410841 Nov 24 16:23:31.487458 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b4ea0c53-5a51-4650-8a8a-0d1c521ac0ef admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a0098d29d009430b851aab8500896aee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0718410 Nov 24 16:23:31.489995 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47338) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:31.539154 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.563056 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.594290 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.597356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.598585 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/730f73e0-b36a-42e2-bbd5-7c8a10a17659 HTTP/1.1" status: 204 len: 168 time: 0.2445736 Nov 24 16:23:31.609023 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdd81fd-53e6-43df-9bcc-770b02c25484 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=730f73e0-b36a-42e2-bbd5-7c8a10a17659,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:31.690358 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.693484 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:31.695687 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f838ac98-388c-470c-b61f-814e0cf5df9f HTTP/1.1" status: 204 len: 168 time: 0.2047348 Nov 24 16:23:31.707788 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d92343-1d60-4252-9b6c-805fd76bdbd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f838ac98-388c-470c-b61f-814e0cf5df9f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:32.190649 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74179481-1a13-4217-b817-c4b87acec590 req-71bd1aa5-7bd7-4ca7-8daf-9973591107e5 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:32.190649 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-74179481-1a13-4217-b817-c4b87acec590 req-71bd1aa5-7bd7-4ca7-8daf-9973591107e5 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.0706468 Nov 24 16:23:32.206704 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50568ea3-fc35-4b0b-a322-4f4192d34f66 req-ca4bec1e-719d-40b1-9e96-7a2f7963de0e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:32.208509 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-50568ea3-fc35-4b0b-a322-4f4192d34f66 req-ca4bec1e-719d-40b1-9e96-7a2f7963de0e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0662897 Nov 24 16:23:32.263926 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-74179481-1a13-4217-b817-c4b87acec590 req-55b2c030-275f-4531-be82-50f6a9c09818 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679095 Nov 24 16:23:32.276738 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-50568ea3-fc35-4b0b-a322-4f4192d34f66 req-8b652db4-98a6-4db7-9823-f1075b04b3bf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611546 Nov 24 16:23:32.483829 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47400) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:32.525812 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47404) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:32.525985 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-64b78bf2-71a0-4078-adce-f76711249daf admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=76f063f002be4305897ca24b6cb36319&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0408537 Nov 24 16:23:32.578188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:32.604639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:32.718628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:32.722044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:32.722557 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fdb3dcd6-ebb0-4e26-9f98-054adbe9108a HTTP/1.1" status: 204 len: 168 time: 0.1955621 Nov 24 16:23:32.730799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df4bd6a2-2865-4d7c-9020-74e66b2e8442 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdb3dcd6-ebb0-4e26-9f98-054adbe9108a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:33.216461 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47438) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:33.414054 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86389e5f-67f7-4fe5-807f-5f428a61d107 req-14dd330a-5b0e-4960-87fb-48e2b9281a97 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:33.416413 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86389e5f-67f7-4fe5-807f-5f428a61d107 req-14dd330a-5b0e-4960-87fb-48e2b9281a97 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.0573633 Nov 24 16:23:33.418961 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fb6ee9-c7f4-4c80-805b-65d6933480e9 req-57d7e76b-de11-4c66-838f-3b107ea3cde2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:33.427663 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-29fb6ee9-c7f4-4c80-805b-65d6933480e9 req-57d7e76b-de11-4c66-838f-3b107ea3cde2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0667367 Nov 24 16:23:33.473818 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86389e5f-67f7-4fe5-807f-5f428a61d107 req-8800588d-d719-4edc-bb9e-1c14a9b1278b tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510883 Nov 24 16:23:33.489016 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-29fb6ee9-c7f4-4c80-805b-65d6933480e9 req-bd6d9b53-a607-4355-92e7-8ed3633fc0bf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603857 Nov 24 16:23:33.489912 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e83757f3-1269-4f72-ace2-5978361be06e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.582826 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e83757f3-1269-4f72-ace2-5978361be06e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.696467 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e83757f3-1269-4f72-ace2-5978361be06e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.738153 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e83757f3-1269-4f72-ace2-5978361be06e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=45c0ffcaa2c244a29fca52cb0400765b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5250616 Nov 24 16:23:33.739055 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83757f3-1269-4f72-ace2-5978361be06e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deba973b-37c7-4fa0-ab34-4c645f021273,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:33.740807 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47470) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:33.801341 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.826447 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.949028 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.950975 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:33.953810 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/deba973b-37c7-4fa0-ab34-4c645f021273 HTTP/1.1" status: 204 len: 168 time: 0.2120125 Nov 24 16:23:33.966925 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f1bdd0-da77-4c7d-8c0a-023943d5c1cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deba973b-37c7-4fa0-ab34-4c645f021273,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:34.053976 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d484a84-9ada-418e-b1f3-fc5379560414 req-c4fac58b-0542-492a-bd74-1682e583b176 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:34.055673 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3d484a84-9ada-418e-b1f3-fc5379560414 req-c4fac58b-0542-492a-bd74-1682e583b176 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.0787377 Nov 24 16:23:34.067046 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47484) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:34.111588 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3d484a84-9ada-418e-b1f3-fc5379560414 req-5e66f839-a6a7-4e65-8c08-92a5c0ad63a5 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497787 Nov 24 16:23:34.223474 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0fd6637-552c-4616-88b7-f656306c819e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.308847 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0fd6637-552c-4616-88b7-f656306c819e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.376281 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0fd6637-552c-4616-88b7-f656306c819e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.419419 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47498) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:34.419963 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b0fd6637-552c-4616-88b7-f656306c819e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=dc853f90b235495caff16f60cdd36c85&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3514197 Nov 24 16:23:34.420520 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0fd6637-552c-4616-88b7-f656306c819e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e191b26-c4bf-4252-9177-45c930328c12,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:34.488695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.510479 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.630654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f1b9b2-2525-4e7f-b630-4b4341061856 req-25ed8bcf-dc77-4d92-9d6b-bb90bbfc54ee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:34.633030 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7f1b9b2-2525-4e7f-b630-4b4341061856 req-25ed8bcf-dc77-4d92-9d6b-bb90bbfc54ee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0562890 Nov 24 16:23:34.656905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.659515 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.660620 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0e191b26-c4bf-4252-9177-45c930328c12 HTTP/1.1" status: 204 len: 168 time: 0.2392385 Nov 24 16:23:34.673392 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5a5132-531b-46f0-88b4-70239de75572 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e191b26-c4bf-4252-9177-45c930328c12,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:34.719492 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7f1b9b2-2525-4e7f-b630-4b4341061856 req-782afc42-f5ba-453d-bf7b-47966f41be37 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801001 Nov 24 16:23:34.732580 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47524) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:34.752405 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-76640a0b-3f10-4ef9-8a17-f555141b9052 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.831959 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-76640a0b-3f10-4ef9-8a17-f555141b9052 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.890564 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-76640a0b-3f10-4ef9-8a17-f555141b9052 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:34.929129 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76640a0b-3f10-4ef9-8a17-f555141b9052 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbebdb7c-862a-4784-bbd3-04e73932e573,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:34.933406 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-76640a0b-3f10-4ef9-8a17-f555141b9052 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8424551625d8476bba03fb487b08d93c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1996462 Nov 24 16:23:34.936083 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47530) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:34.986217 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.006978 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.113250 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.115914 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.117921 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bbebdb7c-862a-4784-bbd3-04e73932e573 HTTP/1.1" status: 204 len: 168 time: 0.1805241 Nov 24 16:23:35.125841 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328e415e-c8be-4fab-98ca-9c3b7a1612f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbebdb7c-862a-4784-bbd3-04e73932e573,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:35.273212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b1e0c2-d7f6-4a01-9a58-700abd0cfc56 req-15f02240-897d-4da7-afc4-634a05b21523 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:35.274745 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e3b1e0c2-d7f6-4a01-9a58-700abd0cfc56 req-15f02240-897d-4da7-afc4-634a05b21523 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.0739253 Nov 24 16:23:35.334345 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e3b1e0c2-d7f6-4a01-9a58-700abd0cfc56 req-bc11c1bc-34c3-4e16-8502-1cfde2a0a2c8 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512476 Nov 24 16:23:35.597771 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47546) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:35.626534 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47550) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:35.650684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c1065625-323b-4c4e-98f7-8f894fb74c8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.741350 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c1065625-323b-4c4e-98f7-8f894fb74c8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.815981 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c1065625-323b-4c4e-98f7-8f894fb74c8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.835594 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-da371f96-d417-4752-ad19-259a870808ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.859671 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c1065625-323b-4c4e-98f7-8f894fb74c8f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2379670fd4cd4a48a116bf5a819a8895&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2273500 Nov 24 16:23:35.859900 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1065625-323b-4c4e-98f7-8f894fb74c8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e78c302-b587-44f1-a481-b6e28b6aad30,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:35.865277 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47562) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:35.890791 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cd8793-da03-42bc-9e58-4ef2d50a1367 req-49538726-9e71-4ae3-acff-b66ed10d08f0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:35.893527 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-10cd8793-da03-42bc-9e58-4ef2d50a1367 req-49538726-9e71-4ae3-acff-b66ed10d08f0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.1039603 Nov 24 16:23:35.937602 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.961704 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:35.992137 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-f655b0b8-22eb-46ed-8866-c6699546d0e4 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:35.996345 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-f655b0b8-22eb-46ed-8866-c6699546d0e4 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.84 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.1225455 Nov 24 16:23:36.043459 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-10cd8793-da03-42bc-9e58-4ef2d50a1367 req-0368a8cc-ff8b-460d-9624-fdd9d58dfcee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202085 Nov 24 16:23:36.085598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.088351 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.089538 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1e78c302-b587-44f1-a481-b6e28b6aad30 HTTP/1.1" status: 204 len: 168 time: 0.2233117 Nov 24 16:23:36.098096 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff144b6-cc6b-44d1-bc93-790894136f46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e78c302-b587-44f1-a481-b6e28b6aad30,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:36.122110 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-da371f96-d417-4752-ad19-259a870808ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.144961 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Deleting port f63ca65c-d50b-4e88-8453-832022ad1f33 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:23:36.145306 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.202317 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-da371f96-d417-4752-ad19-259a870808ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.262877 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-da371f96-d417-4752-ad19-259a870808ea admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7b9d4ee8fffd4799b7c3f45911f9deb4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6632774 Nov 24 16:23:36.264688 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47578) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:36.272336 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da371f96-d417-4752-ad19-259a870808ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=044f611c-c868-4ed0-b97b-9598973bf806,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:36.284446 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] For port f63ca65c-d50b-4e88-8453-832022ad1f33, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f63ca65c-d50b-4e88-8453-832022ad1f33,segment=NetworkSegment(5dbcf00b-55c9-460c-99de-d8b326c48163),segment_id=5dbcf00b-55c9-460c-99de-d8b326c48163)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:23:36.284833 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.302697 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Calling delete_port for f63ca65c-d50b-4e88-8453-832022ad1f33 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:23:36.341868 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.365897 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.520763 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.524379 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.524700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96be0cdc-dfe9-47fa-8440-01c8f5ce2356 req-66c75626-b449-4125-80ad-d76f24e8b7f6 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:36.529018 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96be0cdc-dfe9-47fa-8440-01c8f5ce2356 req-66c75626-b449-4125-80ad-d76f24e8b7f6 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 949 time: 0.0734131 Nov 24 16:23:36.530111 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/044f611c-c868-4ed0-b97b-9598973bf806 HTTP/1.1" status: 204 len: 168 time: 0.2635276 Nov 24 16:23:36.542711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9fb0551-6323-4ca0-a436-bc176c775972 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=044f611c-c868-4ed0-b97b-9598973bf806,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:36.589715 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96be0cdc-dfe9-47fa-8440-01c8f5ce2356 req-683b4e65-0d5b-4b0e-9b49-af172d4cb9f2 tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/security-groups?id=c632df7c-3635-4625-9319-7ce3a6388b26&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570574 Nov 24 16:23:36.661968 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.679978 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['f63ca65c-d50b-4e88-8453-832022ad1f33'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:23:36.696512 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Pushing event deleted for resources: {'Port': ['ID=f63ca65c-d50b-4e88-8453-832022ad1f33,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:36.740628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] No DVR routers for this DVR port f63ca65c-d50b-4e88-8453-832022ad1f33 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:23:36.743556 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:36.747415 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8c63206e-bc84-4437-ac95-5139c5a8334d req-01dd13f3-fdf2-489f-a809-05ee4d3f4e0d tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.84 "DELETE /v2.0/ports/f63ca65c-d50b-4e88-8453-832022ad1f33 HTTP/1.1" status: 204 len: 173 time: 0.7412925 Nov 24 16:23:36.748087 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'name': 'network-vif-deleted', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:23:36.750751 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa3ec3b6-dc3b-4a12-923c-60547afd05b2" -d '{"events": [{"server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "name": "network-vif-deleted", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:23:36.792607 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:23:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33c25c29-a5f7-4723-a9f1-70e099997bde x-openstack-request-id: req-33c25c29-a5f7-4723-a9f1-70e099997bde {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:23:36.792964 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e8f4761-eff5-4e0a-b632-c8b44834e1ef", "name": "network-vif-deleted", "tag": "f63ca65c-d50b-4e88-8453-832022ad1f33", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:23:36.793272 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-33c25c29-a5f7-4723-a9f1-70e099997bde {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:23:36.793623 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e8f4761-eff5-4e0a-b632-c8b44834e1ef', 'name': 'network-vif-deleted', 'tag': 'f63ca65c-d50b-4e88-8453-832022ad1f33', 'status': 'completed', 'code': 200} Nov 24 16:23:37.118773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47612) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:37.152436 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d7530691-f535-4f8c-8257-98ae258bf727 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.184282 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4a617c-a79b-44df-b0a0-0f5505941915 req-4d4d1f19-88b9-4cc7-a140-8fc42b9133db tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:37.185787 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca4a617c-a79b-44df-b0a0-0f5505941915 req-4d4d1f19-88b9-4cc7-a140-8fc42b9133db tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0806808 Nov 24 16:23:37.259535 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca4a617c-a79b-44df-b0a0-0f5505941915 req-8229da04-6b85-4447-9fcd-3d5d75419eba tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659795 Nov 24 16:23:37.286125 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d7530691-f535-4f8c-8257-98ae258bf727 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.404222 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d7530691-f535-4f8c-8257-98ae258bf727 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.449912 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d7530691-f535-4f8c-8257-98ae258bf727 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3c15d3b78338453689d78f4743f4e61e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3298011 Nov 24 16:23:37.450787 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7530691-f535-4f8c-8257-98ae258bf727 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b80301f8-fae9-4b6e-b16d-a1226cee23ae,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:37.453619 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47630) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:37.510155 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.534514 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.669698 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.672322 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:37.674082 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b80301f8-fae9-4b6e-b16d-a1226cee23ae HTTP/1.1" status: 204 len: 168 time: 0.2192035 Nov 24 16:23:37.689294 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210959ee-d5d0-4d71-bee3-9adcc234f054 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b80301f8-fae9-4b6e-b16d-a1226cee23ae,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:37.734654 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-afd8cfe6-c8c6-4644-9a38-4beab7621d8a req-14da0ec3-3605-4a59-ba92-7a8a914870ca tempest-VolumesNegativeTest-1720908700 tempest-VolumesNegativeTest-1720908700-project] 10.222.0.82 "GET /v2.0/ports?device_id=1e8f4761-eff5-4e0a-b632-c8b44834e1ef HTTP/1.1" status: 200 len: 210 time: 0.0406468 Nov 24 16:23:38.406520 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39648c5-c977-4812-8347-52ae2a75738f req-cfc3d75a-b472-4b5b-9805-7d4b9279d443 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:38.424731 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c39648c5-c977-4812-8347-52ae2a75738f req-cfc3d75a-b472-4b5b-9805-7d4b9279d443 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0824130 Nov 24 16:23:38.469219 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c39648c5-c977-4812-8347-52ae2a75738f req-da50cc32-ba48-4f3e-8c02-1a8b8af201a0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523298 Nov 24 16:23:39.085471 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47726) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:39.190625 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-08126c28-bb6a-4b44-a5d5-e7fe17f3193a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.265749 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-08126c28-bb6a-4b44-a5d5-e7fe17f3193a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.341967 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-08126c28-bb6a-4b44-a5d5-e7fe17f3193a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.386866 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08126c28-bb6a-4b44-a5d5-e7fe17f3193a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bd86c93-e92f-4d36-88bf-a7eeff64304c,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:39.391142 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-08126c28-bb6a-4b44-a5d5-e7fe17f3193a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d3c9a8584bfd4cc1b614666c7204e9f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3046579 Nov 24 16:23:39.398617 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47736) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:39.455863 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.477563 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.604878 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.613309 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:39.613309 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7bd86c93-e92f-4d36-88bf-a7eeff64304c HTTP/1.1" status: 204 len: 168 time: 0.2112708 Nov 24 16:23:39.621718 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa1f5fe-9afc-4de9-b125-7a20aa5db6d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bd86c93-e92f-4d36-88bf-a7eeff64304c,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:39.691139 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f63ca65c-d50b-4e88-8453-832022ad1f33 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:23:39.713693 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: f63ca65c-d50b-4e88-8453-832022ad1f33 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:23:39.714040 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f63ca65c-d50b-4e88-8453-832022ad1f33 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:23:40.209799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47764) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:40.226723 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5adbc8f3-6431-4566-8056-dc9c0eec0f15 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.304336 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5adbc8f3-6431-4566-8056-dc9c0eec0f15 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.364004 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5adbc8f3-6431-4566-8056-dc9c0eec0f15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.403248 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-5adbc8f3-6431-4566-8056-dc9c0eec0f15 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a3889cfa60cb418891eb3b379d3695ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1921489 Nov 24 16:23:40.404396 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5adbc8f3-6431-4566-8056-dc9c0eec0f15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a89c1e11-cc8d-41cc-af1c-2a417e934ffa,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:40.408118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47772) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:40.462100 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.487837 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.599293 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.602755 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:40.604087 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a89c1e11-cc8d-41cc-af1c-2a417e934ffa HTTP/1.1" status: 204 len: 168 time: 0.1948032 Nov 24 16:23:40.612929 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-843dc3c7-9459-4bad-b30d-d460a0f7a7dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a89c1e11-cc8d-41cc-af1c-2a417e934ffa,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:40.901172 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4991829a-980e-4469-9962-ddeccabed2f1 req-26d6c2c9-088e-4968-a062-6f12b3186d7a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:40.902736 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4991829a-980e-4469-9962-ddeccabed2f1 req-26d6c2c9-088e-4968-a062-6f12b3186d7a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0541389 Nov 24 16:23:40.951543 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4991829a-980e-4469-9962-ddeccabed2f1 req-fae23c6c-5b2c-4e13-bab8-8d400d402e09 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423059 Nov 24 16:23:41.632847 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47848) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:41.759328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9ac1cf44-0bed-4e92-a93a-83a2148e206b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:41.878373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9ac1cf44-0bed-4e92-a93a-83a2148e206b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:41.941722 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9ac1cf44-0bed-4e92-a93a-83a2148e206b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:41.982222 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9ac1cf44-0bed-4e92-a93a-83a2148e206b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=49294931280d44a78204cb55bc8e7da1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3471785 Nov 24 16:23:41.986347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ac1cf44-0bed-4e92-a93a-83a2148e206b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c86bd7eb-dc35-494d-8671-ed53827c165a,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:41.988589 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47890) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:42.145372 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ce9939-2207-4f45-8265-3155eef177e4 req-0ea5dae5-0c77-4b13-a2fb-adbd8d30e440 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:42.146868 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-36ce9939-2207-4f45-8265-3155eef177e4 req-0ea5dae5-0c77-4b13-a2fb-adbd8d30e440 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0934222 Nov 24 16:23:42.171143 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:42.211734 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:42.242666 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-36ce9939-2207-4f45-8265-3155eef177e4 req-e1fdbccb-0699-4ef5-8dbe-69176af90833 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827043 Nov 24 16:23:42.364888 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:42.367612 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:42.369559 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c86bd7eb-dc35-494d-8671-ed53827c165a HTTP/1.1" status: 204 len: 168 time: 0.3782051 Nov 24 16:23:42.380857 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4988d33d-8405-4a71-9f64-189077d756b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c86bd7eb-dc35-494d-8671-ed53827c165a,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:43.222328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 47982) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:43.238090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1df96c8a-a245-4657-ae57-79dbbae96b9c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.317093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1df96c8a-a245-4657-ae57-79dbbae96b9c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.375948 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1df96c8a-a245-4657-ae57-79dbbae96b9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.428190 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 47994) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:43.428773 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1df96c8a-a245-4657-ae57-79dbbae96b9c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=e2f61ef305574599b7074e0d8c2dce09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2050631 Nov 24 16:23:43.429430 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df96c8a-a245-4657-ae57-79dbbae96b9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0168f0af-b81b-48c2-ba72-29bd0c43d09c,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:43.485626 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.506989 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.741904 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.744777 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:43.745917 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0168f0af-b81b-48c2-ba72-29bd0c43d09c HTTP/1.1" status: 204 len: 168 time: 0.3155081 Nov 24 16:23:43.753953 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b879e69-7aa9-4696-ad0a-b88ca0dac1de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0168f0af-b81b-48c2-ba72-29bd0c43d09c,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:45.291434 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-addf3eb7-4466-4a39-88ca-8f7b42ad33f3 req-85dc2bc5-8227-4b64-8351-7b2caf64946d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:45.292958 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-addf3eb7-4466-4a39-88ca-8f7b42ad33f3 req-85dc2bc5-8227-4b64-8351-7b2caf64946d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0653055 Nov 24 16:23:45.352754 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-addf3eb7-4466-4a39-88ca-8f7b42ad33f3 req-98362d44-cbff-4b65-8eaf-eef083a833c4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529866 Nov 24 16:23:46.469797 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ecc9282-4a0d-44b2-a229-cf2a8d4ab433 req-ebf6041e-96a7-4e34-8c60-c75b25de8331 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:46.471308 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2ecc9282-4a0d-44b2-a229-cf2a8d4ab433 req-ebf6041e-96a7-4e34-8c60-c75b25de8331 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0495763 Nov 24 16:23:46.520705 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2ecc9282-4a0d-44b2-a229-cf2a8d4ab433 req-2ec6e3b4-3ce7-48e6-a7d6-74141fde3a89 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436463 Nov 24 16:23:46.935780 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-13237972-4b5d-49fc-8604-5643e5ae3226 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.552367 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48314) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:47.653092 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8fdbfe-e6de-4e1b-bb93-596fd950cdf5 req-f87432c2-d3a7-41c0-8ece-7cc3ec695e4d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:47.654679 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ab8fdbfe-e6de-4e1b-bb93-596fd950cdf5 req-f87432c2-d3a7-41c0-8ece-7cc3ec695e4d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0521584 Nov 24 16:23:47.668612 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6ea4d09-352f-4267-bff0-d0d80052523d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.705280 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ab8fdbfe-e6de-4e1b-bb93-596fd950cdf5 req-2e5194f0-201d-4d17-952d-a15742563e35 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431063 Nov 24 16:23:47.758480 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6ea4d09-352f-4267-bff0-d0d80052523d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.816133 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6ea4d09-352f-4267-bff0-d0d80052523d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.854773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ea4d09-352f-4267-bff0-d0d80052523d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=612bd7db-d2fb-45ef-af7a-10cffa3d0d21,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:47.861711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48330) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:47.861881 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b6ea4d09-352f-4267-bff0-d0d80052523d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=448db7d75dde471fbfdc771477d0a420&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3082998 Nov 24 16:23:47.909951 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:47.932146 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:48.101629 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:48.106129 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:48.109647 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/612bd7db-d2fb-45ef-af7a-10cffa3d0d21 HTTP/1.1" status: 204 len: 168 time: 0.2440734 Nov 24 16:23:48.117889 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d266d0d4-8527-4307-b72a-fee5f734d6c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=612bd7db-d2fb-45ef-af7a-10cffa3d0d21,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:48.757286 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48352) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:48.772149 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d456940-4a91-4b16-9207-edb2f75d4fa7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:48.809382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48356) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:48.866056 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d456940-4a91-4b16-9207-edb2f75d4fa7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:48.911434 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c8565b-b161-4994-9d0f-47d5a83737fe req-1df03492-e418-4498-8647-fd8dbf20e6a7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:48.914871 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3c8565b-b161-4994-9d0f-47d5a83737fe req-1df03492-e418-4498-8647-fd8dbf20e6a7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.1092296 Nov 24 16:23:48.942596 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8d456940-4a91-4b16-9207-edb2f75d4fa7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.069717 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3c8565b-b161-4994-9d0f-47d5a83737fe req-a0f4fd80-c726-4ef3-996c-76290050fd33 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606649 Nov 24 16:23:49.184486 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8d456940-4a91-4b16-9207-edb2f75d4fa7 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6789144180f142bdaccf921a5097545d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4260993 Nov 24 16:23:49.187275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48370) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:49.207144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d456940-4a91-4b16-9207-edb2f75d4fa7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b986077-8ecb-45c0-a70c-cf8516f0a66c,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:49.223213 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c4f83fec-abb9-4a7c-80d4-c4ac61e6f586 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ca0360dfada54abab247f755bc90682d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4244049 Nov 24 16:23:49.225602 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48372) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:49.242234 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.262177 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-8cdfc63a-a769-4ce1-87b7-59763732e985 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.267539 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.285838 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.297870 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.398493 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.402432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.403651 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3b986077-8ecb-45c0-a70c-cf8516f0a66c HTTP/1.1" status: 204 len: 168 time: 0.2148554 Nov 24 16:23:49.411505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4629fef-706d-4075-a2b1-239014019cad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b986077-8ecb-45c0-a70c-cf8516f0a66c,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:49.421516 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.424460 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:49.426536 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c632df7c-3635-4625-9319-7ce3a6388b26 HTTP/1.1" status: 204 len: 168 time: 0.1992612 Nov 24 16:23:49.434833 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02ffe613-4e15-4707-a0c8-1e50dd88c060 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c632df7c-3635-4625-9319-7ce3a6388b26,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:49.823225 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48402) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:50.012926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-327e3c34-2a09-417e-8476-405219ab8633 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.102578 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-327e3c34-2a09-417e-8476-405219ab8633 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.165365 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8d55a6-f983-441e-82b5-d0ceba08507c req-5fe57884-547a-4fe5-89be-51513a3d99b9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:50.166755 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5d8d55a6-f983-441e-82b5-d0ceba08507c req-5fe57884-547a-4fe5-89be-51513a3d99b9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0496938 Nov 24 16:23:50.188490 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-327e3c34-2a09-417e-8476-405219ab8633 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.245670 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-327e3c34-2a09-417e-8476-405219ab8633 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=6900c4c6610947a49545e0c8902e5962&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4212174 Nov 24 16:23:50.248443 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48428) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:50.252091 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327e3c34-2a09-417e-8476-405219ab8633 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe7d5453-f4de-46ef-ad54-fe5942e44f98,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:50.265610 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5d8d55a6-f983-441e-82b5-d0ceba08507c req-fb77a4fb-8494-4f24-be82-d9d67793ff48 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922284 Nov 24 16:23:50.301701 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.324945 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.353145 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.462625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.471086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:50.471086 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fe7d5453-f4de-46ef-ad54-fe5942e44f98 HTTP/1.1" status: 204 len: 168 time: 0.2167919 Nov 24 16:23:50.474734 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0182c537-e056-4c04-9944-bc3a5f906c93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe7d5453-f4de-46ef-ad54-fe5942e44f98,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:50.998320 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48464) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:51.018144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4b6b96a3-2aeb-4e69-80e5-9f9cd039004e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.107213 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4b6b96a3-2aeb-4e69-80e5-9f9cd039004e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.170408 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4b6b96a3-2aeb-4e69-80e5-9f9cd039004e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.220006 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48476) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:51.220108 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4b6b96a3-2aeb-4e69-80e5-9f9cd039004e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8228c1d88b4942bf8925c38bc02f93cf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2191050 Nov 24 16:23:51.220393 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6b96a3-2aeb-4e69-80e5-9f9cd039004e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f2cba78-42c2-471d-90c9-9c85d3a39072,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:51.279944 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.303926 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.426084 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16009639-0c6e-4d3d-9fd8-d03bf4e9390d req-38923884-256a-47a5-8d36-bf1f720754af tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:51.428052 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-16009639-0c6e-4d3d-9fd8-d03bf4e9390d req-38923884-256a-47a5-8d36-bf1f720754af tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0642917 Nov 24 16:23:51.458930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.461337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.462488 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8f2cba78-42c2-471d-90c9-9c85d3a39072 HTTP/1.1" status: 204 len: 168 time: 0.2431262 Nov 24 16:23:51.480794 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e33331-475d-4ea7-88a3-f232c3aa26ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f2cba78-42c2-471d-90c9-9c85d3a39072,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:51.494748 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-16009639-0c6e-4d3d-9fd8-d03bf4e9390d req-2fef91ce-7c4a-4a58-912c-f3d5fcb9f379 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585022 Nov 24 16:23:51.747573 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:51.937120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48510) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:52.214618 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8de69271-4bb4-4c59-86f9-f26602311564 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.290081 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8de69271-4bb4-4c59-86f9-f26602311564 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.303683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48526) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:52.317340 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-141a49c4-0797-43c6-a084-ac3087037d26 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.359898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8de69271-4bb4-4c59-86f9-f26602311564 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.410022 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.418719 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8de69271-4bb4-4c59-86f9-f26602311564 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=00b79bf7043a4dc7bb7893575d1af5c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4797337 Nov 24 16:23:52.419581 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de69271-4bb4-4c59-86f9-f26602311564 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3160b264-dba4-44dc-a139-07caabab11ac,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:52.421479 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48532) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:52.433823 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-141a49c4-0797-43c6-a084-ac3087037d26 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.479307 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.495950 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-141a49c4-0797-43c6-a084-ac3087037d26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.499900 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.535346 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141a49c4-0797-43c6-a084-ac3087037d26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e768b3c4-3d64-420c-8c80-160863abfc13,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:52.544437 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-141a49c4-0797-43c6-a084-ac3087037d26 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=28648e6e29e64c1da078e46c3e6623e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2396750 Nov 24 16:23:52.545030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48542) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:52.594680 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.616265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.657058 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.659795 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.661374 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3160b264-dba4-44dc-a139-07caabab11ac HTTP/1.1" status: 204 len: 168 time: 0.2386889 Nov 24 16:23:52.671789 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5c60b4-724a-48ae-a654-fe9008b058c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3160b264-dba4-44dc-a139-07caabab11ac,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:52.770174 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.772991 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:52.774856 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e768b3c4-3d64-420c-8c80-160863abfc13 HTTP/1.1" status: 204 len: 168 time: 0.2288799 Nov 24 16:23:52.782779 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52093ddb-41a9-428b-87c9-4a103208c7fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e768b3c4-3d64-420c-8c80-160863abfc13,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:53.431232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48568) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:53.445598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6d5ce929-1104-460c-bce6-5557448b56c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.522344 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6d5ce929-1104-460c-bce6-5557448b56c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.581783 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6d5ce929-1104-460c-bce6-5557448b56c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.621513 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-6d5ce929-1104-460c-bce6-5557448b56c5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bac899147e524b9abb3772f34c66b90b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1891930 Nov 24 16:23:53.622473 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ce929-1104-460c-bce6-5557448b56c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b7e2b9e-8ce8-4490-a52b-b1fd93de1e6b,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:53.624192 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48574) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:53.674812 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.696445 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.832732 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.835380 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:53.837232 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0b7e2b9e-8ce8-4490-a52b-b1fd93de1e6b HTTP/1.1" status: 204 len: 168 time: 0.2105744 Nov 24 16:23:53.845848 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30688453-e3db-472f-a48a-dbc3704e2a66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b7e2b9e-8ce8-4490-a52b-b1fd93de1e6b,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:54.258987 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc3dcc7-6628-4879-b781-f56ecd11131a req-f82b95ed-77af-4902-ab5d-695e543617b6 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:54.260488 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5cc3dcc7-6628-4879-b781-f56ecd11131a req-f82b95ed-77af-4902-ab5d-695e543617b6 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0539143 Nov 24 16:23:54.334317 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5cc3dcc7-6628-4879-b781-f56ecd11131a req-43688e72-4cb9-422e-8861-ac98b348a0f1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520036 Nov 24 16:23:55.445096 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53db83d8-515a-44b8-9020-4c765856810c req-1e14334c-6300-4e77-bd14-e85fdd79d560 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:55.446717 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53db83d8-515a-44b8-9020-4c765856810c req-1e14334c-6300-4e77-bd14-e85fdd79d560 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0523410 Nov 24 16:23:55.475624 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48672) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:55.504414 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53db83d8-515a-44b8-9020-4c765856810c req-c405d9a3-7334-4614-930a-d5b0ab91ef04 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408325 Nov 24 16:23:55.582698 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d499ee24-5b17-49f5-b68c-318f6d8c7874 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:55.654027 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d499ee24-5b17-49f5-b68c-318f6d8c7874 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:55.735890 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d499ee24-5b17-49f5-b68c-318f6d8c7874 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:55.774782 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d499ee24-5b17-49f5-b68c-318f6d8c7874 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=fabd9778643f435ba9403b3f914c63c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2979136 Nov 24 16:23:55.775654 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d499ee24-5b17-49f5-b68c-318f6d8c7874 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ba72961-28a5-443b-9b2f-57abd4300d06,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:55.777600 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48676) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:55.842163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:55.865271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:56.027520 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:56.030283 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:56.031839 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6ba72961-28a5-443b-9b2f-57abd4300d06 HTTP/1.1" status: 204 len: 168 time: 0.2530291 Nov 24 16:23:56.040625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44589863-1284-4600-85ab-f4987be20e4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ba72961-28a5-443b-9b2f-57abd4300d06,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:56.764550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48726) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:56.869717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5c151ba-0e00-4d30-8274-5ebfc0d87342 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:56.951374 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5c151ba-0e00-4d30-8274-5ebfc0d87342 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.021630 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5c151ba-0e00-4d30-8274-5ebfc0d87342 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.061164 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d5c151ba-0e00-4d30-8274-5ebfc0d87342 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=37a34f7053e045078c10427a3b7e7b9d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2971983 Nov 24 16:23:57.062286 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c151ba-0e00-4d30-8274-5ebfc0d87342 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b90fbe7d-bd3e-4a9d-875a-bc95aedef922,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:57.063866 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48746) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:57.132451 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.167256 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.284252 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.287938 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.292419 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b90fbe7d-bd3e-4a9d-875a-bc95aedef922 HTTP/1.1" status: 204 len: 168 time: 0.2245913 Nov 24 16:23:57.298634 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb4e4faf-99dd-4e4e-a5a4-6343da34b3a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b90fbe7d-bd3e-4a9d-875a-bc95aedef922,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:57.906381 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48770) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:57.919641 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8063545e-440e-42d6-b66c-27c4034d227c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:57.994108 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8063545e-440e-42d6-b66c-27c4034d227c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.049852 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8063545e-440e-42d6-b66c-27c4034d227c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.089467 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8063545e-440e-42d6-b66c-27c4034d227c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c8962456e6b44d3baa1eb35869e2a2e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1818886 Nov 24 16:23:58.090241 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8063545e-440e-42d6-b66c-27c4034d227c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1fdef76-c4c8-47f8-9279-c7b46b7a6ceb,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:58.092172 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48778) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:23:58.153280 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.176628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.312140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.314781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:58.315958 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c1fdef76-c4c8-47f8-9279-c7b46b7a6ceb HTTP/1.1" status: 204 len: 168 time: 0.2227852 Nov 24 16:23:58.325794 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15f5f1a-1a72-4e82-b6b5-b37729bd8dd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1fdef76-c4c8-47f8-9279-c7b46b7a6ceb,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:23:58.650337 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:23:59.124010 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81f7982-bfc3-43f9-b6b9-9a13885b55a1 req-680330d5-54e9-44b9-9f68-73a46181023f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:59.125598 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a81f7982-bfc3-43f9-b6b9-9a13885b55a1 req-680330d5-54e9-44b9-9f68-73a46181023f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0518236 Nov 24 16:23:59.180412 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a81f7982-bfc3-43f9-b6b9-9a13885b55a1 req-87e19b2a-bc49-488b-9b3e-8abdf3438644 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472188 Nov 24 16:23:59.218704 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60244b44-72c4-4287-8e2d-164cd5d57748 req-4e5d32dc-6603-43eb-af5e-c215871a5c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:23:59.220241 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60244b44-72c4-4287-8e2d-164cd5d57748 req-4e5d32dc-6603-43eb-af5e-c215871a5c58 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1099 time: 0.0420310 Nov 24 16:23:59.269567 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60244b44-72c4-4287-8e2d-164cd5d57748 req-5d915788-2a73-414c-9bf7-9e1f2d7e3370 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386553 Nov 24 16:24:00.322949 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29115d2b-e328-41f6-8719-9b26b69ac532 req-cf300b54-2f06-4387-b147-46a28912433c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:00.324487 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29115d2b-e328-41f6-8719-9b26b69ac532 req-cf300b54-2f06-4387-b147-46a28912433c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0520120 Nov 24 16:24:00.380060 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29115d2b-e328-41f6-8719-9b26b69ac532 req-c95d88d2-d5fa-40e5-bc4f-f7388472641c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492189 Nov 24 16:24:01.503882 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aef8dd6-3228-4fa2-91bb-77de14973b07 req-f07e29b8-2503-409f-b860-333e73af1993 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:01.507235 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0aef8dd6-3228-4fa2-91bb-77de14973b07 req-f07e29b8-2503-409f-b860-333e73af1993 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0487573 Nov 24 16:24:01.553257 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0aef8dd6-3228-4fa2-91bb-77de14973b07 req-47a815c7-d4bb-4327-93d7-6151a859890e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417740 Nov 24 16:24:01.572510 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 48896) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:01.675760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d517125-c089-4ddd-9b7b-9dcf878c59f9 req-2a59b90d-9e95-497a-84ae-8388a4472229 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:01.683186 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1d517125-c089-4ddd-9b7b-9dcf878c59f9 req-2a59b90d-9e95-497a-84ae-8388a4472229 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0561228 Nov 24 16:24:01.692249 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-536d66c3-0332-462d-9d3b-4fe3c4d03e5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.731424 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1d517125-c089-4ddd-9b7b-9dcf878c59f9 req-0287148d-5058-4fd4-befa-688240bfc435 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473378 Nov 24 16:24:01.765557 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-536d66c3-0332-462d-9d3b-4fe3c4d03e5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.849718 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-536d66c3-0332-462d-9d3b-4fe3c4d03e5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.892880 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-536d66c3-0332-462d-9d3b-4fe3c4d03e5f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=55a0fec879c94f39ac621bffc07cea74&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3189147 Nov 24 16:24:01.894029 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536d66c3-0332-462d-9d3b-4fe3c4d03e5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15f650f6-2be4-49a0-ac17-5da62f2f432a,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:01.895599 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48910) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:01.953936 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:01.974496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.095595 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.098280 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.101791 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/15f650f6-2be4-49a0-ac17-5da62f2f432a HTTP/1.1" status: 204 len: 168 time: 0.2025602 Nov 24 16:24:02.109578 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2500de-056d-48f6-b6c6-ff6777b4dcad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15f650f6-2be4-49a0-ac17-5da62f2f432a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:02.806708 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48938) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:02.823615 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e1a7fcb-3f0f-444d-96cd-faeccd5af6e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.899137 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e1a7fcb-3f0f-444d-96cd-faeccd5af6e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:02.970173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e1a7fcb-3f0f-444d-96cd-faeccd5af6e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.013580 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e1a7fcb-3f0f-444d-96cd-faeccd5af6e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8751ce79-01ef-4df5-a2c1-b2986a6cdcc3,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:03.019109 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9e1a7fcb-3f0f-444d-96cd-faeccd5af6e5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=5769641008dd43e7bd114f02157b88d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2111564 Nov 24 16:24:03.021569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 48946) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:03.077668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.101569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.201748 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.204471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:03.205634 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8751ce79-01ef-4df5-a2c1-b2986a6cdcc3 HTTP/1.1" status: 204 len: 168 time: 0.1829679 Nov 24 16:24:03.216637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d163bd53-5dd1-4da7-9d9e-88eadac95c92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8751ce79-01ef-4df5-a2c1-b2986a6cdcc3,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:05.160926 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:24:06.334799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c5be16-ae1d-4d48-932a-44b233a2e9cc req-d9527904-5ee1-4b41-aca0-82756e5aa9ac tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:06.336980 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-70c5be16-ae1d-4d48-932a-44b233a2e9cc req-d9527904-5ee1-4b41-aca0-82756e5aa9ac tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0497367 Nov 24 16:24:06.389066 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49094) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:06.430272 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-17b10ae0-8737-4da6-99d3-22fb14c3a782 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:06.432117 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-17b10ae0-8737-4da6-99d3-22fb14c3a782 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0649745 Nov 24 16:24:06.456348 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-70c5be16-ae1d-4d48-932a-44b233a2e9cc req-2c2ceb62-8bd3-47bb-abee-5ef6d1afa663 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896671 Nov 24 16:24:06.519753 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a3c77702-a695-467b-a73a-9ef1ecc445f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.593344 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a3c77702-a695-467b-a73a-9ef1ecc445f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.650097 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49100) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:06.684315 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a3c77702-a695-467b-a73a-9ef1ecc445f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.722312 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a3c77702-a695-467b-a73a-9ef1ecc445f4 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4d5739cddc83448c884f9c205d4733af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3304121 Nov 24 16:24:06.724702 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c77702-a695-467b-a73a-9ef1ecc445f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6265739b-7322-4773-9424-ff156fb5afb5,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:06.725084 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49104) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:06.761584 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1d3641db-4b7e-4e5d-acbb-25e7ccdb38d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.785187 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.806547 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.834978 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1d3641db-4b7e-4e5d-acbb-25e7ccdb38d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.900661 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1d3641db-4b7e-4e5d-acbb-25e7ccdb38d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.930166 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.932758 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:06.936341 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/6265739b-7322-4773-9424-ff156fb5afb5 HTTP/1.1" status: 204 len: 168 time: 0.2078826 Nov 24 16:24:06.940949 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d3641db-4b7e-4e5d-acbb-25e7ccdb38d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb849f38-68d4-4efe-a880-4843c9a58bd4,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:06.949530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50ae1a48-6887-4a2e-b168-4f6e33a867db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6265739b-7322-4773-9424-ff156fb5afb5,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:06.952864 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-1d3641db-4b7e-4e5d-acbb-25e7ccdb38d2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1521f0464dd64bbe872b1156945d7d32&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3016698 Nov 24 16:24:06.956444 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49110) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:07.022063 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:07.044674 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:07.158681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:07.161403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:07.162541 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/bb849f38-68d4-4efe-a880-4843c9a58bd4 HTTP/1.1" status: 204 len: 168 time: 0.2049832 Nov 24 16:24:07.170331 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bbbc6a8-ce6b-4d7f-8c7e-bf85f3347162 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb849f38-68d4-4efe-a880-4843c9a58bd4,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:07.585616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-39f3af9c-b6dc-4c0d-a450-5af784c0c11f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:07.587446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-39f3af9c-b6dc-4c0d-a450-5af784c0c11f service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.3217111 Nov 24 16:24:08.864848 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49158) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:08.965125 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fe6f74da-6b5c-493f-8e50-4d9c6fbfe3aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.036745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fe6f74da-6b5c-493f-8e50-4d9c6fbfe3aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.113065 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fe6f74da-6b5c-493f-8e50-4d9c6fbfe3aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.150210 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-fe6f74da-6b5c-493f-8e50-4d9c6fbfe3aa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d23de7ab0a544d1fa4698e21b9d4e25c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2842956 Nov 24 16:24:09.152198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6f74da-6b5c-493f-8e50-4d9c6fbfe3aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f7a64e3-7b8f-444a-a909-7adee048ed3e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:09.152853 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49166) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:09.202233 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.223103 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.294854 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-b0317d3a-26ce-4a8c-90f9-6f9f55aacbe1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0387528 Nov 24 16:24:09.324629 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.327736 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:09.328929 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/0f7a64e3-7b8f-444a-a909-7adee048ed3e HTTP/1.1" status: 204 len: 168 time: 0.1750813 Nov 24 16:24:09.338119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd770c73-f29a-4010-9413-7c62020718ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f7a64e3-7b8f-444a-a909-7adee048ed3e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:09.373246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-2d8075e6-0b91-4780-9d52-8bb15060c37e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:09.374750 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-2d8075e6-0b91-4780-9d52-8bb15060c37e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0562813 Nov 24 16:24:09.406377 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a0a546-42be-493c-a14b-9d76b1c323c3 req-bec123c5-1770-468e-aea5-0f7ec542bbd1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:09.407881 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b6a0a546-42be-493c-a14b-9d76b1c323c3 req-bec123c5-1770-468e-aea5-0f7ec542bbd1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0519149 Nov 24 16:24:09.412877 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-c67df8cd-62d5-4848-8d53-2a089d567ce0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0269208 Nov 24 16:24:09.457276 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b6a0a546-42be-493c-a14b-9d76b1c323c3 req-df20a56d-c836-43f9-96b7-048ee3c248aa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428362 Nov 24 16:24:09.524117 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-fafe4aa3-5224-480e-843b-a4e3ee582074 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1012011 Nov 24 16:24:09.616739 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a5b6572-c1cd-4654-b5f8-5da80d1606fa req-d26bc882-3457-4109-9dc0-002efe7d36bf service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832264 Nov 24 16:24:10.578798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe1f005-8c7a-4db9-9da1-6e95a0eda908 req-4b8a27d0-e608-4cf0-9cd8-cc512f6d449e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:10.580562 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0fe1f005-8c7a-4db9-9da1-6e95a0eda908 req-4b8a27d0-e608-4cf0-9cd8-cc512f6d449e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0484571 Nov 24 16:24:10.633263 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0fe1f005-8c7a-4db9-9da1-6e95a0eda908 req-bacb593a-d70d-4675-a4aa-549b29f52306 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461414 Nov 24 16:24:13.791785 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b02eec81-16ef-446f-801b-d4bcab155f77 req-310dddc8-4e1a-4930-8973-8380c952ab88 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:13.793226 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b02eec81-16ef-446f-801b-d4bcab155f77 req-310dddc8-4e1a-4930-8973-8380c952ab88 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0465701 Nov 24 16:24:13.842302 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b02eec81-16ef-446f-801b-d4bcab155f77 req-7e44ae31-874c-455a-aa80-8e3747e1adf3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432484 Nov 24 16:24:14.961605 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14fa7c7-037c-45a2-9903-f55e9d9deace req-55adb6c2-2ce1-4243-af51-88cddc79f777 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:14.963727 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f14fa7c7-037c-45a2-9903-f55e9d9deace req-55adb6c2-2ce1-4243-af51-88cddc79f777 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0488591 Nov 24 16:24:15.023536 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f14fa7c7-037c-45a2-9903-f55e9d9deace req-0226b5d6-9837-45d8-9326-493e2118102d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497656 Nov 24 16:24:15.628176 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49338) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:15.730020 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-12a06147-e9dc-44d1-b3e6-9661af988971 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:15.802352 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-12a06147-e9dc-44d1-b3e6-9661af988971 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:15.872674 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-12a06147-e9dc-44d1-b3e6-9661af988971 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:15.921278 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-12a06147-e9dc-44d1-b3e6-9661af988971 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=641fe83cb1ed4638ae4a81c68b93a0a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2919967 Nov 24 16:24:15.922025 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a06147-e9dc-44d1-b3e6-9661af988971 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17debf85-dbdf-498f-8518-e6652055b13f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:15.924266 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49346) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:15.973443 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:15.995831 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:16.142890 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:16.145544 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:16.146673 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/17debf85-dbdf-498f-8518-e6652055b13f HTTP/1.1" status: 204 len: 168 time: 0.2213743 Nov 24 16:24:16.156618 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d1071d5-c2fe-42be-8c88-cb26975dabd9 req-6966db03-3615-454a-a058-f0950c512f3d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:16.158416 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8d1071d5-c2fe-42be-8c88-cb26975dabd9 req-6966db03-3615-454a-a058-f0950c512f3d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0741045 Nov 24 16:24:16.168804 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7cb1ce-7fc5-482e-a8e6-481754fe08ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17debf85-dbdf-498f-8518-e6652055b13f,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:16.237404 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8d1071d5-c2fe-42be-8c88-cb26975dabd9 req-8de05382-84aa-44b5-b379-29208c40f885 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706155 Nov 24 16:24:16.808142 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49384) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:16.825140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8ef9ce1a-62a6-4bd0-9180-542f7f5f9b6f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:16.906771 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-54bab7c3-f79a-4a55-9d29-9958c4dc2e70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:16.914292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8ef9ce1a-62a6-4bd0-9180-542f7f5f9b6f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.015766 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8ef9ce1a-62a6-4bd0-9180-542f7f5f9b6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.053673 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8ef9ce1a-62a6-4bd0-9180-542f7f5f9b6f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=f9314573dff34a1886e97cecb8fffa4f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2443471 Nov 24 16:24:17.054780 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef9ce1a-62a6-4bd0-9180-542f7f5f9b6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7649327-f898-4458-a9f0-b133e31e0d54,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:17.057543 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49390) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:17.111920 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.133044 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.243773 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.246379 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:17.247596 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/b7649327-f898-4458-a9f0-b133e31e0d54 HTTP/1.1" status: 204 len: 168 time: 0.1890564 Nov 24 16:24:17.255562 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8fa59b3-9289-447b-8ccd-dbf4c03410a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7649327-f898-4458-a9f0-b133e31e0d54,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:17.359797 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbe7d3d-de33-4104-95b6-ce0e3179f624 req-08a194f0-4cf1-4901-a68c-5b50f329b595 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:17.361256 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6dbe7d3d-de33-4104-95b6-ce0e3179f624 req-08a194f0-4cf1-4901-a68c-5b50f329b595 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0506418 Nov 24 16:24:17.409986 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6dbe7d3d-de33-4104-95b6-ce0e3179f624 req-02003d13-2ee2-49c5-9b14-f45ac2fef6a9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428336 Nov 24 16:24:17.951541 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49416) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:17.964375 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6db299c3-ff1f-4d51-8060-b10377415221 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.037534 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6db299c3-ff1f-4d51-8060-b10377415221 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.112905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6db299c3-ff1f-4d51-8060-b10377415221 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.154061 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-6db299c3-ff1f-4d51-8060-b10377415221 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c6c15b9d353a482697d4ea7eaa7f7c89&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2014925 Nov 24 16:24:18.156134 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db299c3-ff1f-4d51-8060-b10377415221 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8887d1c5-385d-4d18-beca-fc78036db332,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:18.158231 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49424) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:18.235027 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.257229 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.444563 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.448345 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:18.449879 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8887d1c5-385d-4d18-beca-fc78036db332 HTTP/1.1" status: 204 len: 168 time: 0.2900774 Nov 24 16:24:18.460568 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef6d8bfb-94b5-4bf3-851b-5d1e5431c494 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8887d1c5-385d-4d18-beca-fc78036db332,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:18.537218 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dd5356-7d88-43b9-bb9a-87c17dad008a req-b196fbd4-1149-4ba5-8857-186570a8d11d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:18.539160 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e1dd5356-7d88-43b9-bb9a-87c17dad008a req-b196fbd4-1149-4ba5-8857-186570a8d11d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0575864 Nov 24 16:24:18.589298 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e1dd5356-7d88-43b9-bb9a-87c17dad008a req-424720b6-5956-46ed-ac46-f9afd2611756 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442405 Nov 24 16:24:19.261439 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2764fc89-3bdd-450b-b874-7aee45ca4055 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:19.884149 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d205f3b5-4e7c-4e70-92cb-ac32dbe563ec req-e30f90e3-86c2-4742-92a4-c37e6b241520 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:19.885734 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d205f3b5-4e7c-4e70-92cb-ac32dbe563ec req-e30f90e3-86c2-4742-92a4-c37e6b241520 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0642140 Nov 24 16:24:19.937260 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d205f3b5-4e7c-4e70-92cb-ac32dbe563ec req-a300beaf-0482-4145-b9e4-d6435855cb2b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451977 Nov 24 16:24:20.049095 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec1b655-7687-4ffe-b53f-0adae0154a60 req-766f3ae9-8382-4123-8ca1-98527be386cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:20.050745 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3ec1b655-7687-4ffe-b53f-0adae0154a60 req-766f3ae9-8382-4123-8ca1-98527be386cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0560274 Nov 24 16:24:20.105467 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3ec1b655-7687-4ffe-b53f-0adae0154a60 req-2fb7c601-40cb-44a6-963b-095e7fdaa82f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484588 Nov 24 16:24:20.341278 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.089796 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4e11f8-eab5-4594-92f4-9f0c555940b2 req-95fed128-8749-4e9d-82b9-5aca4ea17f11 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:21.095607 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f4e11f8-eab5-4594-92f4-9f0c555940b2 req-95fed128-8749-4e9d-82b9-5aca4ea17f11 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0843198 Nov 24 16:24:21.118703 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49598) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:21.162985 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f4e11f8-eab5-4594-92f4-9f0c555940b2 req-aa791fae-0573-4b71-a853-2d9344d112b9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636899 Nov 24 16:24:21.239124 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a6f4abab-5933-434c-b715-5ada97740c9b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.253757 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37418176-3311-484f-97d2-3edb9e1d2591 req-72b4c151-ddae-4dbc-ac2c-9d255ac52f7a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:21.255331 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37418176-3311-484f-97d2-3edb9e1d2591 req-72b4c151-ddae-4dbc-ac2c-9d255ac52f7a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0604892 Nov 24 16:24:21.305899 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37418176-3311-484f-97d2-3edb9e1d2591 req-26f3b34e-d4ce-4242-b6eb-cd2446618c48 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439379 Nov 24 16:24:21.350487 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a6f4abab-5933-434c-b715-5ada97740c9b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.485197 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a6f4abab-5933-434c-b715-5ada97740c9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.526990 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a6f4abab-5933-434c-b715-5ada97740c9b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4aaa94ff47bd444088591bdbabff5db6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4071672 Nov 24 16:24:21.527884 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f4abab-5933-434c-b715-5ada97740c9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b848ee1-f8ca-474d-9e4e-6337da29ca67,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:21.530853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49620) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:21.590668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.613800 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.698736 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.798832 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.802337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:21.804304 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7b848ee1-f8ca-474d-9e4e-6337da29ca67 HTTP/1.1" status: 204 len: 168 time: 0.2716992 Nov 24 16:24:21.813998 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b848ee1-f8ca-474d-9e4e-6337da29ca67,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:21.822010 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.822370 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.822714 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.823075 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.823412 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.823744 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.824073 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.824402 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.824730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.825050 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.825513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:21.825799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dccfaaee-93c4-4dac-8f1a-6150a15cda1a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:22.286102 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb306b3b-7a47-4693-8059-294173130947 req-cf6b5b8d-92e0-4e01-8b44-47a1c984d76c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:22.345558 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cb306b3b-7a47-4693-8059-294173130947 req-cf6b5b8d-92e0-4e01-8b44-47a1c984d76c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0492039 Nov 24 16:24:22.347410 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cb306b3b-7a47-4693-8059-294173130947 req-5a8ba189-9cec-42f9-b1bb-958989f98794 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499399 Nov 24 16:24:22.415273 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:22.454190 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ff7805-f30d-42db-8139-1a7ea0b42828 req-ce91011e-a5aa-45e7-8c39-d9c00aafba3d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:22.455900 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-47ff7805-f30d-42db-8139-1a7ea0b42828 req-ce91011e-a5aa-45e7-8c39-d9c00aafba3d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0518203 Nov 24 16:24:22.503548 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-47ff7805-f30d-42db-8139-1a7ea0b42828 req-413b5931-032e-4fa9-8ecf-b1ca7cb1f622 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409896 Nov 24 16:24:23.361689 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-a6860bbc-4c50-4944-89de-1784c1313b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:23.363158 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-a6860bbc-4c50-4944-89de-1784c1313b5d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0382988 Nov 24 16:24:23.473759 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb6d0d7-0493-4546-8ae4-5e46e15a1781 req-a1424e5b-df8b-42cb-9603-a61cd2039506 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:23.475454 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dbb6d0d7-0493-4546-8ae4-5e46e15a1781 req-a1424e5b-df8b-42cb-9603-a61cd2039506 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0584919 Nov 24 16:24:23.479965 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-9572b3d0-570a-4f6a-9a6c-c8438ee59c2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:23.481444 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-9572b3d0-570a-4f6a-9a6c-c8438ee59c2f service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.0961668 Nov 24 16:24:23.532628 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-34b0565f-2c8b-4981-99c6-a043cee0ee73 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0432577 Nov 24 16:24:23.534395 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dbb6d0d7-0493-4546-8ae4-5e46e15a1781 req-39ff17c2-b8da-47e1-98c8-3a1a76ac0518 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517397 Nov 24 16:24:23.612399 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-3ba14ff0-8eb2-44b9-8bf4-862cf6d0b3c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:23.613817 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-3ba14ff0-8eb2-44b9-8bf4-862cf6d0b3c2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0738387 Nov 24 16:24:23.640323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30fadc6-727a-4977-94a5-27ec41b75b8f req-bf4bdc97-1633-42a5-af61-fa6b977b9243 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:23.641772 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f30fadc6-727a-4977-94a5-27ec41b75b8f req-bf4bdc97-1633-42a5-af61-fa6b977b9243 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0633214 Nov 24 16:24:23.658062 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-47353132-20a8-4502-a5ce-91d53cb7a839 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0335035 Nov 24 16:24:23.760868 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f30fadc6-727a-4977-94a5-27ec41b75b8f req-b9cd1409-c647-450c-927b-8254844e1de0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1051815 Nov 24 16:24:23.781098 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-7d7491d3-a457-46a3-b9e9-3c19f77ee1e8 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1150668 Nov 24 16:24:23.874284 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a4264e67-a506-4991-a5d6-fe7ae4e91004 req-bff2c879-a5a0-490d-9041-dbd96a46126f service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831316 Nov 24 16:24:24.652323 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942fe34a-1817-49ca-8a6a-d6360799c130 req-d4093aa0-e325-49bf-9aea-8f7d9f184dc5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:24.653801 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-942fe34a-1817-49ca-8a6a-d6360799c130 req-d4093aa0-e325-49bf-9aea-8f7d9f184dc5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0484579 Nov 24 16:24:24.703275 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-942fe34a-1817-49ca-8a6a-d6360799c130 req-b6b95534-9be2-4726-9671-dd1b1f1343cf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436237 Nov 24 16:24:24.884142 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43703f21-a4c2-411f-9ad5-67cfeb0419bc req-a381c34c-f13d-48e4-9889-5000b43c8846 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:24.885599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-43703f21-a4c2-411f-9ad5-67cfeb0419bc req-a381c34c-f13d-48e4-9889-5000b43c8846 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0520337 Nov 24 16:24:24.931958 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-43703f21-a4c2-411f-9ad5-67cfeb0419bc req-51f356d0-40bf-4ddb-bd35-c217bb2a6ca8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402811 Nov 24 16:24:25.139917 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49676) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:25.245534 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c73a087a-9b85-4493-9cbb-b14417b41d82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.318592 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c73a087a-9b85-4493-9cbb-b14417b41d82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.369789 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c73a087a-9b85-4493-9cbb-b14417b41d82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.408306 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c73a087a-9b85-4493-9cbb-b14417b41d82 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7a930c255b8a4c179987ad3a76d3d572&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2673638 Nov 24 16:24:25.409218 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73a087a-9b85-4493-9cbb-b14417b41d82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2d7a928-ceb1-4342-b2fb-b1ff7930aa35,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:25.410976 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49682) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:25.462329 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.483246 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.580952 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.583648 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:25.585228 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d2d7a928-ceb1-4342-b2fb-b1ff7930aa35 HTTP/1.1" status: 204 len: 168 time: 0.1720221 Nov 24 16:24:25.594105 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14fc48d3-f346-46b6-abd1-0d2fb074377c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2d7a928-ceb1-4342-b2fb-b1ff7930aa35,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:25.817640 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17bbba24-7fe8-44e0-97a6-d7ecd91cc1c3 req-2b988155-50fd-4469-a9d2-2b58ff2a2d00 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:25.826616 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-17bbba24-7fe8-44e0-97a6-d7ecd91cc1c3 req-2b988155-50fd-4469-a9d2-2b58ff2a2d00 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0485563 Nov 24 16:24:25.873865 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-17bbba24-7fe8-44e0-97a6-d7ecd91cc1c3 req-e2c29530-14a3-468c-aec7-bb92581613a6 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486338 Nov 24 16:24:26.056901 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e8c4b5-1a90-4396-b2d1-c96f2c5888a0 req-7b30af9e-94ef-4e50-b041-b79a1a874fd7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:26.058503 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-75e8c4b5-1a90-4396-b2d1-c96f2c5888a0 req-7b30af9e-94ef-4e50-b041-b79a1a874fd7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0519226 Nov 24 16:24:26.111000 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-75e8c4b5-1a90-4396-b2d1-c96f2c5888a0 req-47cc89b7-0f56-4f3c-84db-cf68a2595413 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459089 Nov 24 16:24:26.588436 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49714) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:26.680741 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1342184024-network', 'tenant_id': '4562b21a9bec4777b36baec6291778f5'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:26.752414 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Made reservation on behalf of 4562b21a9bec4777b36baec6291778f5 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:24:26.754804 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:26.764008 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:26.844985 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:26.884059 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:26.905942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:24:26.921378 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77b48aa8-a04d-471f-b619-b41c1aec3a12,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:26.923770 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:26.926183 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Added segment 95724655-bda4-4db3-b200-e095f21d8a6d of type vlan for network 3244fb11-f411-4a53-b3cf-8285d8f01d99 Nov 24 16:24:26.937251 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.937613 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.937964 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.938364 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.938650 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.939020 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.939390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.939705 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.940039 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.940369 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.940701 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:26.941027 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:27.002459 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.037655 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c79d83-5e0a-4437-93fc-05cc559006dc req-0c9c3845-99c3-4250-ab5d-98de46d20804 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:27.039240 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-66c79d83-5e0a-4437-93fc-05cc559006dc req-0c9c3845-99c3-4250-ab5d-98de46d20804 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0932603 Nov 24 16:24:27.091113 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-66c79d83-5e0a-4437-93fc-05cc559006dc req-67aada26-d7d1-4cb6-b831-336bbfdc0a69 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439410 Nov 24 16:24:27.094060 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.095060 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:27.095696 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.166237 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] Pushing event updated for resources: {'Network': ['ID=3244fb11-f411-4a53-b3cf-8285d8f01d99,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:27.176007 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:24:27.201215 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-3cf9bcee-2e64-47ce-aa6f-6c36c99aa088 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6113057 Nov 24 16:24:27.204251 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49724) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:27.209324 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Request body: {'subnet': {'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1342184024-subnet', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:27.259076 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41bd156-48c0-4798-8a80-81649487ccf0 req-93c18f6d-2228-4dab-8721-761bfd7d05bf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:27.260783 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b41bd156-48c0-4798-8a80-81649487ccf0 req-93c18f6d-2228-4dab-8721-761bfd7d05bf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0628095 Nov 24 16:24:27.313885 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Made reservation on behalf of 4562b21a9bec4777b36baec6291778f5 for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:24:27.315972 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b41bd156-48c0-4798-8a80-81649487ccf0 req-36744dbf-04f5-4095-b321-77f1e0f3bd0f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491903 Nov 24 16:24:27.320011 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.557559 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.610172 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Pushing event updated for resources: {'Subnet': ['ID=32dfcce0-5f9f-4b5c-b446-29700080ce52,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:27.620173 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Checking segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:27.620530 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Network hostable DHCP agents. Network: 3244fb11-f411-4a53-b3cf-8285d8f01d99, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:24:27.689352 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:24:27.757818 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 3244fb11-f411-4a53-b3cf-8285d8f01d99) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:27.765413 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:27.766031 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.766675 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f894f5eb-1f54-4b64-9e07-d416eeec92ac None None] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:27.851640 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-11de4199-16d6-4bf2-81f5-6785bb8229ad admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6461725 Nov 24 16:24:27.854234 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49732) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:27.858944 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:27.934323 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-3244fb11-f411-4a53-b3cf-8285d8f01d99', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:24:27.935229 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.952697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:27.956125 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.005861 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.080052 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Allocated IP 172.20.0.2 (3244fb11-f411-4a53-b3cf-8285d8f01d99/32dfcce0-5f9f-4b5c-b446-29700080ce52/d65f1f32-61db-4746-b216-344fe99789f3) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:28.250854 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.269453 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.284545 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29d84a4c-3e74-451a-8f60-acc65a25a03a req-3ba332ec-d6a3-4a5f-a372-9faec27262cc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:28.286023 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29d84a4c-3e74-451a-8f60-acc65a25a03a req-3ba332ec-d6a3-4a5f-a372-9faec27262cc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1153233 Nov 24 16:24:28.325261 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.337434 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29d84a4c-3e74-451a-8f60-acc65a25a03a req-6396f090-6dcd-4647-9f81-5f98038a9e73 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448532 Nov 24 16:24:28.395973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:28.404584 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:28.410353 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:28.419848 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Pushing event updated for resources: {'Port': ['ID=d65f1f32-61db-4746-b216-344fe99789f3,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:28.460907 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb8125b-a994-4006-bc46-2f9671660abb req-3503ef80-d1a7-464f-8c85-f07f43f3eda4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:28.467445 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3bb8125b-a994-4006-bc46-2f9671660abb req-3503ef80-d1a7-464f-8c85-f07f43f3eda4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0575511 Nov 24 16:24:28.471653 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.472030 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.472575 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.472930 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.473278 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.473620 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.473955 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.474290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.474641 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.475005 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.475341 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.475689 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:28.490024 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Attempting to bind port d65f1f32-61db-4746-b216-344fe99789f3 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:28.490407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Attempting to bind port d65f1f32-61db-4746-b216-344fe99789f3 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:28.490774 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Attempting to bind port d65f1f32-61db-4746-b216-344fe99789f3 on network 3244fb11-f411-4a53-b3cf-8285d8f01d99 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:28.496202 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:28.496585 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Checking segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:28.497079 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.497491 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Bound using segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:28.497973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Bound port: d65f1f32-61db-4746-b216-344fe99789f3, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:28.498361 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.534275 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3bb8125b-a994-4006-bc46-2f9671660abb req-9928d55b-e598-4f64-aafb-487a95245448 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0633993 Nov 24 16:24:28.573899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] For port d65f1f32-61db-4746-b216-344fe99789f3, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:28.594687 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] For port d65f1f32-61db-4746-b216-344fe99789f3, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d65f1f32-61db-4746-b216-344fe99789f3,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:28.604900 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.623770 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.650148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.673165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.728900 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7683a5a-3ed5-4c0e-bf77-c5b42c651ad0 None None] Pushing event updated for resources: {'Port': ['ID=d65f1f32-61db-4746-b216-344fe99789f3,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:28.749610 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Allocated IP 172.27.2.152 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/c9525fbd-b614-4703-af12-ea71b0b3cce5) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:28.859727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:28.975895 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:29.018224 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:29.021192 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:29.026527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:29.032539 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Pushing event updated for resources: {'Port': ['ID=c9525fbd-b614-4703-af12-ea71b0b3cce5,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:29.355038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd5cfc07-757a-4003-a009-584d30a2d64b req-a8e22178-c0b9-4119-9c75-423843d7e359 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:29.356806 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bd5cfc07-757a-4003-a009-584d30a2d64b req-a8e22178-c0b9-4119-9c75-423843d7e359 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0527773 Nov 24 16:24:29.408342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:29.426226 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bd5cfc07-757a-4003-a009-584d30a2d64b req-3d3a891b-3986-4b55-8f3c-bafef2e8d553 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595865 Nov 24 16:24:29.548935 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d515c29c-5685-4506-a92a-73aa8afa719b req-d95e631c-0814-45cf-a8c2-636df02ba769 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:29.550617 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d515c29c-5685-4506-a92a-73aa8afa719b req-d95e631c-0814-45cf-a8c2-636df02ba769 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1060362 Nov 24 16:24:29.622069 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d65f1f32-61db-4746-b216-344fe99789f3 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:29.661684 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d515c29c-5685-4506-a92a-73aa8afa719b req-97abd068-4925-4698-bd0d-5460b1a35479 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014583 Nov 24 16:24:29.690393 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port d65f1f32-61db-4746-b216-344fe99789f3 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:29.697264 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4cb72a3-4c20-42e9-a2d1-e01cce634b41 req-f85da1f9-ea5e-44b4-9ec7-de4e29f5fb12 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:29.697792 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:29.697902 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f4cb72a3-4c20-42e9-a2d1-e01cce634b41 req-f85da1f9-ea5e-44b4-9ec7-de4e29f5fb12 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0646820 Nov 24 16:24:29.770248 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f4cb72a3-4c20-42e9-a2d1-e01cce634b41 req-db1ca616-4167-4559-a87b-a0f04c78a51e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0674417 Nov 24 16:24:29.799163 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:29.835084 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port d65f1f32-61db-4746-b216-344fe99789f3, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d65f1f32-61db-4746-b216-344fe99789f3,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:29.838413 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fb877dc-e39b-4468-98b7-b7c14c598d46 None None] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:29.912898 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:29.933499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.012620 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-6c58fd71-04b2-431d-bf7d-f7e33f4d526f None None] Provisioning complete for port d65f1f32-61db-4746-b216-344fe99789f3 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:30.012994 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6c58fd71-04b2-431d-bf7d-f7e33f4d526f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.014499 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=d65f1f32-61db-4746-b216-344fe99789f3,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:30.123724 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Router 05159c2b-a330-441e-ab5d-008b311018b8 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:24:30.232970 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:30.242691 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Sync routers for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:30.253722 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:30.253722 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:30.302944 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.304186 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-208793aa-2a64-41c9-99b7-c151133fc943 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.4488854 Nov 24 16:24:30.306975 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49758) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:30.347849 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-5060d0b4-a330-473f-9847-2fe3df08e41c None None] Provisioning complete for port d65f1f32-61db-4746-b216-344fe99789f3 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:30.348316 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5060d0b4-a330-473f-9847-2fe3df08e41c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.366121 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:30.565674 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:29Z', 'revision_number': 3, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:30.600002 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Checking router: 05159c2b-a330-441e-ab5d-008b311018b8 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:30.600353 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Updating router 05159c2b-a330-441e-ab5d-008b311018b8 port c9525fbd-b614-4703-af12-ea71b0b3cce5 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:24:30.624689 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.628155 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd516d77-1b8a-4e75-ab3e-8cf888030480 req-913cfcc0-6ab3-4b65-8c41-2b546ab73fae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:30.629626 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bd516d77-1b8a-4e75-ab3e-8cf888030480 req-913cfcc0-6ab3-4b65-8c41-2b546ab73fae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1066387 Nov 24 16:24:30.728750 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bd516d77-1b8a-4e75-ab3e-8cf888030480 req-a571a7d3-342d-4d2f-a4b1-d92ec202b2b6 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0923405 Nov 24 16:24:30.902379 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.910037 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.934498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b171158b-7aff-4f6c-831b-59538a230826 req-26030469-544f-45bb-aa3e-e764360630a6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:30.936836 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b171158b-7aff-4f6c-831b-59538a230826 req-26030469-544f-45bb-aa3e-e764360630a6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0719733 Nov 24 16:24:30.943784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74b96134-6846-4378-a83b-ba2fdfc0805a req-4331c506-9d38-49c3-a6f1-582bd5c77222 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:30.945375 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-74b96134-6846-4378-a83b-ba2fdfc0805a req-4331c506-9d38-49c3-a6f1-582bd5c77222 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0595436 Nov 24 16:24:30.987649 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:30.999061 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-74b96134-6846-4378-a83b-ba2fdfc0805a req-7f9edd98-92be-405b-b12e-b6cccb2fe0a0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419502 Nov 24 16:24:31.041698 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Pushing event updated for resources: {'Port': ['ID=c9525fbd-b614-4703-af12-ea71b0b3cce5,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:31.050743 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.051169 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.051518 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.051853 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.052184 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.052514 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.052841 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.053165 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.053509 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.054036 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.054361 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.054695 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:24:31.057396 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b171158b-7aff-4f6c-831b-59538a230826 req-ab0f0b39-c864-42ec-8b93-707bddfc10ef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1132696 Nov 24 16:24:31.130817 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Allocated IP 172.20.0.1 (3244fb11-f411-4a53-b3cf-8285d8f01d99/32dfcce0-5f9f-4b5c-b446-29700080ce52/89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:31.184415 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Attempting to bind port c9525fbd-b614-4703-af12-ea71b0b3cce5 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:31.184791 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Attempting to bind port c9525fbd-b614-4703-af12-ea71b0b3cce5 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:31.185157 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Attempting to bind port c9525fbd-b614-4703-af12-ea71b0b3cce5 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:31.190218 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:31.190589 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:31.191022 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.191417 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:31.191877 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Bound port: c9525fbd-b614-4703-af12-ea71b0b3cce5, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:31.192279 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.231591 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.243105 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] For port c9525fbd-b614-4703-af12-ea71b0b3cce5, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:31.245446 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] For port c9525fbd-b614-4703-af12-ea71b0b3cce5, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=c9525fbd-b614-4703-af12-ea71b0b3cce5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:31.318360 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.364128 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.367067 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:31.368309 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:31.412539 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:31.416229 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:31.416738 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a2e07a-b325-496c-9596-9a28c60722e4 None None] Pushing event updated for resources: {'Port': ['ID=c9525fbd-b614-4703-af12-ea71b0b3cce5,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:31.420514 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:31.443151 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Pushing event updated for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:31.461627 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.487474 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:31.556942 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d65f1f32-61db-4746-b216-344fe99789f3 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:31.626251 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port d65f1f32-61db-4746-b216-344fe99789f3 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:31.626635 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.692862 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.731952 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:29Z', 'revision_number': 3, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:31.757602 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c08a9cbf-c780-4e0f-9027-7022f7044acd None None] The sync data for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi is: [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:29Z', 'revision_number': 3, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:31.784187 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-ff9d9f10-6d77-4460-8e71-be9d23b4a434 None None] Provisioning complete for port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:31.784741 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9f10-6d77-4460-8e71-be9d23b4a434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.822886 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-ff9d9f10-6d77-4460-8e71-be9d23b4a434 None None] Port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:24:31.870643 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:31.877460 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f4f01d-d44e-4085-a5a6-a75fd94442ed req-c4430c40-40bd-49eb-9393-a1bea1609454 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:31.879022 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-62f4f01d-d44e-4085-a5a6-a75fd94442ed req-c4430c40-40bd-49eb-9393-a1bea1609454 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0533862 Nov 24 16:24:31.928099 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-62f4f01d-d44e-4085-a5a6-a75fd94442ed req-36691814-75f4-4ed6-970c-f0b8fe309dfc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417297 Nov 24 16:24:31.964119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:32.049449 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Pushing event updated for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:32.055790 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:32.173056 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:32.175281 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:32.253782 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519583e4-da9a-4f51-b5b0-7b43de3f1790 req-59b2a62f-c29b-480e-9521-17f96758735b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:32.255438 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519583e4-da9a-4f51-b5b0-7b43de3f1790 req-59b2a62f-c29b-480e-9521-17f96758735b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0851221 Nov 24 16:24:32.324029 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519583e4-da9a-4f51-b5b0-7b43de3f1790 req-a6d3fa5a-a5ec-4950-9f51-061c04f7bcd2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0569274 Nov 24 16:24:32.357347 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cff18e5-26d8-45c5-88a4-cd9ce4ab064f req-5e552eb8-f852-4c87-a173-ed15a0e53ad4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:32.358941 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8cff18e5-26d8-45c5-88a4-cd9ce4ab064f req-5e552eb8-f852-4c87-a173-ed15a0e53ad4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0710299 Nov 24 16:24:32.451475 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-a9a703eb-1d7e-4df2-ac00-8256d2773bcc None None] Provisioning complete for port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:32.451985 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a9a703eb-1d7e-4df2-ac00-8256d2773bcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:32.466866 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8cff18e5-26d8-45c5-88a4-cd9ce4ab064f req-7ac7371c-59e2-405d-a37f-c0cae643229c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746789 Nov 24 16:24:32.468673 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Router 05159c2b-a330-441e-ab5d-008b311018b8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:32.499188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d24a66-0257-4064-b21f-5f7d38ad0178 req-5681aefa-0afe-4f05-be22-92bbb7519dbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:32.501085 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1d24a66-0257-4064-b21f-5f7d38ad0178 req-5681aefa-0afe-4f05-be22-92bbb7519dbe service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0551507 Nov 24 16:24:32.507981 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-a9a703eb-1d7e-4df2-ac00-8256d2773bcc None None] Port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:24:32.564796 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1d24a66-0257-4064-b21f-5f7d38ad0178 req-fb65193b-6d7e-4fe6-b6f5-bf674f546416 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533686 Nov 24 16:24:32.596140 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:32.602405 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-55ef2d31-2e5c-4d93-a09b-fc3965fea5a9 admin admin] 10.222.0.82 "PUT /v2.0/routers/05159c2b-a330-441e-ab5d-008b311018b8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2936888 Nov 24 16:24:33.050641 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cbb6e7-c6a8-4de6-845b-0b3eebed094c req-ac53da73-584b-410b-998b-02d0674e4b74 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:33.052253 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53cbb6e7-c6a8-4de6-845b-0b3eebed094c req-ac53da73-584b-410b-998b-02d0674e4b74 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0576832 Nov 24 16:24:33.102300 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53cbb6e7-c6a8-4de6-845b-0b3eebed094c req-4ac6c6d8-b3dd-4be4-922e-8b107354401f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437353 Nov 24 16:24:33.277711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49816) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:33.282597 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-984943225-network', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:33.353051 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Made reservation on behalf of b3c83ff7d8a5476892879eb1d197c5ae for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:24:33.355723 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.365111 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.474136 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.483723 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517db8fd-f04e-4f73-b811-e12cb33fffd2 req-337eb474-75ea-4808-b1b0-0702a749b86b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:33.485316 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-517db8fd-f04e-4f73-b811-e12cb33fffd2 req-337eb474-75ea-4808-b1b0-0702a749b86b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0768347 Nov 24 16:24:33.532820 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.534171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Sync routers for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:33.546150 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:33.547921 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:33.571795 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 855} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:24:33.584905 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device c9525fbd-b614-4703-af12-ea71b0b3cce5 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:33.588397 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-517db8fd-f04e-4f73-b811-e12cb33fffd2 req-734a354f-010d-47b4-86a1-5000607d17b3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0895743 Nov 24 16:24:33.591673 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb75dcfe-38bb-46c9-9861-d5f21a4d25c9,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:33.596819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.597198 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Added segment eec903dc-62b4-41d9-ab39-748e8e72b762 of type vlan for network 4a5b2498-2d18-46a7-9cde-172882bf566d Nov 24 16:24:33.645496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175bd116-923e-4f45-b1c0-c017a1de10a1 req-1c60a010-8902-49c8-a438-e34cc8f119a0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:33.648132 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-175bd116-923e-4f45-b1c0-c017a1de10a1 req-1c60a010-8902-49c8-a438-e34cc8f119a0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0953183 Nov 24 16:24:33.663378 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.715618 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-175bd116-923e-4f45-b1c0-c017a1de10a1 req-02151f9b-05a7-4463-9e66-ddb3e8c8039c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607097 Nov 24 16:24:33.718396 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port c9525fbd-b614-4703-af12-ea71b0b3cce5 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:33.718825 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.741804 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:33.769554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.770642 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:33.771228 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:33.835934 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] Pushing event updated for resources: {'Network': ['ID=4a5b2498-2d18-46a7-9cde-172882bf566d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:33.849786 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 4a5b2498-2d18-46a7-9cde-172882bf566d details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:24:33.863786 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e2c6d560-e234-450e-ac36-f0e4034132ae admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5849776 Nov 24 16:24:33.866508 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49826) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:33.871827 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Request body: {'subnet': {'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-984943225-subnet', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:33.952580 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Made reservation on behalf of b3c83ff7d8a5476892879eb1d197c5ae for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:24:33.955136 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.123697 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.161521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port c9525fbd-b614-4703-af12-ea71b0b3cce5, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=c9525fbd-b614-4703-af12-ea71b0b3cce5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:34.209691 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 2, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:34.210458 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.221560 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2975cf43-d5c4-4755-923e-a7a0d021f931 req-f36a544c-346a-4fbe-9210-651e84a206a7 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.223097 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2975cf43-d5c4-4755-923e-a7a0d021f931 req-f36a544c-346a-4fbe-9210-651e84a206a7 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0518270 Nov 24 16:24:34.239764 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Checking router: 05159c2b-a330-441e-ab5d-008b311018b8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:34.240256 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Updating router 05159c2b-a330-441e-ab5d-008b311018b8 port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:24:34.262654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.286970 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.287936 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=78fefca8-6dfc-4d51-afa6-7531a69831e6,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:34.316705 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Checking segment: {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:34.317059 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Network hostable DHCP agents. Network: 4a5b2498-2d18-46a7-9cde-172882bf566d, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:24:34.332823 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2975cf43-d5c4-4755-923e-a7a0d021f931 req-73bb9612-713a-416a-8ec3-6bb06bd16fd6 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0848660 Nov 24 16:24:34.357362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=c9525fbd-b614-4703-af12-ea71b0b3cce5,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:34.403438 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Network 4a5b2498-2d18-46a7-9cde-172882bf566d is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:24:34.489308 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 4a5b2498-2d18-46a7-9cde-172882bf566d) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:34.493669 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.494154 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.503402 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8176a828-b1b7-4bce-aa86-f6f9a92b904f None None] Network 4a5b2498-2d18-46a7-9cde-172882bf566d requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:34.572273 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-be3e1ea4-1366-47f2-956e-863858293cc3 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7046123 Nov 24 16:24:34.575011 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49830) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:34.579893 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:24:34.672871 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.674137 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.679429 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.720080 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-4a5b2498-2d18-46a7-9cde-172882bf566d', 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'fixed_ips': [{'subnet_id': '78fefca8-6dfc-4d51-afa6-7531a69831e6'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:24:34.721042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.771390 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.788747 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5638b6bc-cb82-4622-9f0d-f8cc2b0cdc8e req-4dd43bd9-0e6c-45f9-a2cd-0b188dc9e0ac tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.790563 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:34.792647 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5638b6bc-cb82-4622-9f0d-f8cc2b0cdc8e req-4dd43bd9-0e6c-45f9-a2cd-0b188dc9e0ac tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.1143975 Nov 24 16:24:34.875030 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5638b6bc-cb82-4622-9f0d-f8cc2b0cdc8e req-9d48f519-88e2-4a4b-a079-c6ceb325b47f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0736103 Nov 24 16:24:34.875172 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25576483-33da-4386-9df4-38dbb0ecf825 req-b8901054-46f7-47ee-ad8f-a609aaf3a0be tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:34.875901 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-25576483-33da-4386-9df4-38dbb0ecf825 req-b8901054-46f7-47ee-ad8f-a609aaf3a0be tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0720000 Nov 24 16:24:34.931589 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-25576483-33da-4386-9df4-38dbb0ecf825 req-3d5d9690-1b06-4f3d-9654-c8011ca8d64c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472012 Nov 24 16:24:34.944809 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Allocated IP 172.20.0.2 (4a5b2498-2d18-46a7-9cde-172882bf566d/78fefca8-6dfc-4d51-afa6-7531a69831e6/0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:34.947387 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e616436a-72d1-4018-b3bb-ec5635a1ba45 None None] Pushing event updated for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:35.009709 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Attempting to bind port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:35.010073 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Attempting to bind port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:35.010439 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Attempting to bind port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 on network 3244fb11-f411-4a53-b3cf-8285d8f01d99 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:35.025414 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:35.025791 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Checking segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:35.026195 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.026589 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Bound using segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:35.027116 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Bound port: 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:35.027666 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.057029 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.157562 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] For port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:35.165328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] For port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:35.206052 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-b4755d5f-157f-40d4-9bdf-d9e6db3a7501 None None] Provisioning complete for port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:35.206410 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b4755d5f-157f-40d4-9bdf-d9e6db3a7501 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.235198 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.250341 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-b4755d5f-157f-40d4-9bdf-d9e6db3a7501 None None] Port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:24:35.290296 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.329392 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.348886 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.360621 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Network 4a5b2498-2d18-46a7-9cde-172882bf566d is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:35.364837 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e616436a-72d1-4018-b3bb-ec5635a1ba45 None None] Pushing event updated for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:35.368224 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:35.371846 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:35.372533 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:35.376357 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:35.396690 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.422206 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929a12ec-a405-4f63-aabb-1a3153131852 req-e12a9b67-8d86-442a-9100-536f90530ca0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:35.423644 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-929a12ec-a405-4f63-aabb-1a3153131852 req-e12a9b67-8d86-442a-9100-536f90530ca0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1211622 Nov 24 16:24:35.507332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-2b3cde0e-3266-4b60-b059-8869fb75440d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:35.517080 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-2b3cde0e-3266-4b60-b059-8869fb75440d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.1344402 Nov 24 16:24:35.517218 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2213752-e8bf-4023-a154-0df2801b06d4 req-736d238b-f82c-441f-8fd9-facead008fe4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:35.525531 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f2213752-e8bf-4023-a154-0df2801b06d4 req-736d238b-f82c-441f-8fd9-facead008fe4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0907652 Nov 24 16:24:35.547019 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Pushing event updated for resources: {'Port': ['ID=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:35.603566 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device c9525fbd-b614-4703-af12-ea71b0b3cce5 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:35.618973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Attempting to bind port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:35.618973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Attempting to bind port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:35.618973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Attempting to bind port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 on network 4a5b2498-2d18-46a7-9cde-172882bf566d {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:35.619191 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-929a12ec-a405-4f63-aabb-1a3153131852 req-cfcb3263-e7e1-44ce-a170-a0c183740cfe tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1576552 Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Checking segment: {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Bound using segment: {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Bound port: 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:35.657729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.671982 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Allocated IP 172.27.2.104 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/9a8aa74c-7422-4d90-bc2d-24bf8d50817d) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:35.710835 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:35.723922 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-5ebd02ec-9a2d-4903-a124-17044c8997fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:35.725418 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-5ebd02ec-9a2d-4903-a124-17044c8997fa service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.1919003 Nov 24 16:24:35.803092 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] Provisioning complete for port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:35.803533 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.804066 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-7360bed3-289e-4147-82ee-8e12ee65917f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0420313 Nov 24 16:24:35.855708 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f2213752-e8bf-4023-a154-0df2801b06d4 req-8394b50d-d71b-4a6f-9437-e05a881b925b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3294694 Nov 24 16:24:35.893708 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:35.904731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-fa0112f8-100d-41cd-870a-01e00876f972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:35.906219 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-fa0112f8-100d-41cd-870a-01e00876f972 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0928993 Nov 24 16:24:35.953294 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-9704d5e1-3d53-4481-99ba-01ba20d3ba70 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0339329 Nov 24 16:24:36.051045 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port c9525fbd-b614-4703-af12-ea71b0b3cce5 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:36.051707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.059399 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] For port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:36.076108 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3583a6d0-3456-4e29-8a1f-8791f5b5ad1d req-57211ec2-d651-4edc-bf1a-33612c24a608 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:36.077612 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3583a6d0-3456-4e29-8a1f-8791f5b5ad1d req-57211ec2-d651-4edc-bf1a-33612c24a608 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.1234360 Nov 24 16:24:36.135055 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] For port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:36.224492 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.238541 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.327220 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.352087 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-c26b04ef-c424-4624-918d-d4f0e75c57af service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3809922 Nov 24 16:24:36.361962 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb234a65-1122-4f5d-b56a-af8088101c49 None None] Pushing event updated for resources: {'Port': ['ID=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:36.369359 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] For port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:36.383195 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:35Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:36.387700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:36.402844 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:36.406649 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:36.411514 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60fa748e-3b7e-4033-8d04-6bf7d036d20c None None] The sync data for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi is: [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:35Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:36.426672 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:36.534302 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d8f4ba-07e1-4756-9f21-0caec0dd9f98 None None] Pushing event updated for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:36.540186 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Pushing event updated for resources: {'Port': ['ID=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:36.575236 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3583a6d0-3456-4e29-8a1f-8791f5b5ad1d req-f44ab2b3-f3bd-496a-b315-f64d478fa1ce tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4905655 Nov 24 16:24:36.716878 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-954a5f0b-8b4d-40ae-a073-08d3e1ecf016 req-5bb8ef49-f4b5-42ce-a6ae-e9215a5a4027 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3405309 Nov 24 16:24:36.772590 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd05e8a-092d-4ca0-850a-9a82c9f979c7 req-d2008aa4-4622-4d2c-add3-5a272b8317f1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:36.774230 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9fd05e8a-092d-4ca0-850a-9a82c9f979c7 req-d2008aa4-4622-4d2c-add3-5a272b8317f1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0734723 Nov 24 16:24:36.826699 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9fd05e8a-092d-4ca0-850a-9a82c9f979c7 req-586d940e-d4e8-4441-807e-63fdd856ca51 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455875 Nov 24 16:24:36.999975 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.046490 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8263889-344f-46f0-9ebb-c05b5078a97f req-465c963a-f5cd-4151-a917-a48fb1a61437 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.048058 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a8263889-344f-46f0-9ebb-c05b5078a97f req-465c963a-f5cd-4151-a917-a48fb1a61437 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0995178 Nov 24 16:24:37.143212 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a8263889-344f-46f0-9ebb-c05b5078a97f req-0cb07358-eda7-4d7e-bc4d-2dee3edb472d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0850942 Nov 24 16:24:37.266830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.424003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22b5224f-dcac-42ce-a236-b1b32e3575f5 None None] Network 4a5b2498-2d18-46a7-9cde-172882bf566d requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:24:37.510036 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Router 17c49c91-aac3-4197-b22c-97f1162ad379 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:24:37.514967 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] Provisioning complete for port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:37.514967 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.640984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:37.653045 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:37.664714 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Sync routers for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:37.677980 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:37.678605 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:37.728038 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.747286 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a025ca-1e91-41ac-9938-24eb638d2624 req-d436fb27-ff48-45a9-a129-cec7712f6788 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:37.749762 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-05a025ca-1e91-41ac-9938-24eb638d2624 req-d436fb27-ff48-45a9-a129-cec7712f6788 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0589395 Nov 24 16:24:37.756802 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.764098 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9e55c93a-e9ca-4462-9752-fe712a4881a6 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.1830404 Nov 24 16:24:37.764098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49864) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:37.793475 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:37.794045 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.805577 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:37.858160 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-05a025ca-1e91-41ac-9938-24eb638d2624 req-160aebc7-3f91-404f-9357-dec080873722 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0932298 Nov 24 16:24:37.865039 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] For port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:37.938521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:37.953285 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:38.064585 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 3, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:38.076178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3795f89-3ebb-4bb7-8e8f-f017adb3c650 None None] Pushing event updated for resources: {'Port': ['ID=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:38.109117 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-0171b0eb-4cc4-44f6-a52c-d7f48a173d35 None None] Provisioning complete for port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:38.109489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0171b0eb-4cc4-44f6-a52c-d7f48a173d35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.114199 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Checking router: 17c49c91-aac3-4197-b22c-97f1162ad379 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:38.114650 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Updating router 17c49c91-aac3-4197-b22c-97f1162ad379 port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:24:38.141799 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.144371 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0d5b22-d089-45d5-b352-882a346aa809 req-caed93e4-3079-4b86-9a60-27d6009a3943 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:38.145978 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bc0d5b22-d089-45d5-b352-882a346aa809 req-caed93e4-3079-4b86-9a60-27d6009a3943 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1601181 Nov 24 16:24:38.169362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:38.169362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.212282 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bc0d5b22-d089-45d5-b352-882a346aa809 req-c9400f89-81ab-4ca2-8788-4a8caec04998 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548346 Nov 24 16:24:38.323096 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e295da-9536-4b6a-a6d0-0a017ec2bae2 req-2c9ea21c-2153-40e2-b24c-1a1fdb156eef tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:38.325123 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f8e295da-9536-4b6a-a6d0-0a017ec2bae2 req-2c9ea21c-2153-40e2-b24c-1a1fdb156eef tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0680149 Nov 24 16:24:38.379420 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f8e295da-9536-4b6a-a6d0-0a017ec2bae2 req-648341eb-1cb7-449a-ae2f-d2a52cf90912 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419569 Nov 24 16:24:38.435789 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.464644 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.506679 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.565438 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Attempting to bind port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:38.565813 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Attempting to bind port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:38.566180 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Attempting to bind port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:38.568017 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10349d09-3513-41e8-82af-b32be9d85ae5 None None] Pushing event updated for resources: {'Port': ['ID=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:38.574049 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:38.574425 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:38.574824 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.575234 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:38.575974 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Bound port: 9a8aa74c-7422-4d90-bc2d-24bf8d50817d, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:38.576956 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.633773 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] For port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:38.637000 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Allocated IP 172.20.0.1 (4a5b2498-2d18-46a7-9cde-172882bf566d/78fefca8-6dfc-4d51-afa6-7531a69831e6/689a2b14-53de-4fd4-8fb1-2b656a2f8db9) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:24:38.637156 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] For port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:38.718231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.736200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.784431 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:38.785065 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:38.820842 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10349d09-3513-41e8-82af-b32be9d85ae5 None None] Pushing event updated for resources: {'Port': ['ID=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:38.831916 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.867266 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Network 4a5b2498-2d18-46a7-9cde-172882bf566d is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:38.870148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:38.875667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:24:38.901127 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:38.914710 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Pushing event updated for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:38.937782 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:38.950513 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:24:39.056341 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b50e51-708a-4d58-9286-c7e30255c5fe req-b2dfb6d1-462d-40ba-8c87-f429210bad61 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:39.057899 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d8b50e51-708a-4d58-9286-c7e30255c5fe req-b2dfb6d1-462d-40ba-8c87-f429210bad61 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0768750 Nov 24 16:24:39.147755 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:39.164669 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:24:39.168887 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 3, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:39.224413 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d8b50e51-708a-4d58-9286-c7e30255c5fe req-89d331e1-0024-477d-abeb-690d7944495c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1474938 Nov 24 16:24:39.228486 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.248814 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:24:39.286447 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:39.293324 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f6d731-79a4-4326-9cdb-bca1b68d160a None None] The sync data for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi is: [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 3, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:39.300292 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-d8c55aca-b092-498a-8030-04fd9ecce6ce None None] Provisioning complete for port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:39.306063 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d8c55aca-b092-498a-8030-04fd9ecce6ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.326220 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.346770 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-d8c55aca-b092-498a-8030-04fd9ecce6ce None None] Port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:24:39.369662 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.452100 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=6']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:39.481109 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-765c1c0c-8332-40e2-83d5-b877b5b3a38c req-3bbd2589-5b15-470f-a7c1-e72b21027e39 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:39.485207 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-765c1c0c-8332-40e2-83d5-b877b5b3a38c req-3bbd2589-5b15-470f-a7c1-e72b21027e39 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1402838 Nov 24 16:24:39.526928 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['be934a2b-3080-4139-8519-7b3fdd48d05e'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:24:39.572672 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-765c1c0c-8332-40e2-83d5-b877b5b3a38c req-16e296eb-5f1e-4373-be63-1cf2f5980e99 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811856 Nov 24 16:24:39.618825 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:39.693545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.704065 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a4c0e9-bdb8-4f9f-83ca-94d7fd4d5577 req-c78fc686-7096-447d-9e91-5c0084318561 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:39.711848 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-69a4c0e9-bdb8-4f9f-83ca-94d7fd4d5577 req-c78fc686-7096-447d-9e91-5c0084318561 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1996012 Nov 24 16:24:39.750309 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:39.750784 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.782577 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-69a4c0e9-bdb8-4f9f-83ca-94d7fd4d5577 req-0b3e4ddc-43da-494d-9589-d9aa6742c71b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0642388 Nov 24 16:24:39.783944 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.893137 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:39.902150 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Pushing event updated for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:40.002542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Network 4a5b2498-2d18-46a7-9cde-172882bf566d is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:24:40.004389 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:24:40.173153 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Router 17c49c91-aac3-4197-b22c-97f1162ad379 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:24:40.286390 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-debb9130-f298-4d37-a656-f0e726f1ad59 None None] Provisioning complete for port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:40.286848 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-debb9130-f298-4d37-a656-f0e726f1ad59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:40.344382 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:24:40.350529 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7a2c025c-1306-4544-bf1e-b71bce7c0f3b admin admin] 10.222.0.82 "PUT /v2.0/routers/17c49c91-aac3-4197-b22c-97f1162ad379/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5872383 Nov 24 16:24:40.359570 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-debb9130-f298-4d37-a656-f0e726f1ad59 None None] Port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:24:40.417827 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5a74a4-e8d7-447d-a51c-deab1cdf5ea3 req-2c091700-dd1a-4f48-b039-4ab5385ff57c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:40.423948 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2e5a74a4-e8d7-447d-a51c-deab1cdf5ea3 req-2c091700-dd1a-4f48-b039-4ab5385ff57c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 945 time: 0.0726447 Nov 24 16:24:40.490313 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2e5a74a4-e8d7-447d-a51c-deab1cdf5ea3 req-fab8d57f-8a9f-4c70-983f-d06866bc0f45 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0603817 Nov 24 16:24:40.928387 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f1b239-c791-48cf-81a1-f4200ed1ae73 req-2a928dda-aad3-436f-8e1c-ad5e7e6cc255 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:40.936601 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-29f1b239-c791-48cf-81a1-f4200ed1ae73 req-2a928dda-aad3-436f-8e1c-ad5e7e6cc255 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0608165 Nov 24 16:24:40.943366 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:40.999255 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-29f1b239-c791-48cf-81a1-f4200ed1ae73 req-581058f1-a05d-4241-9dc4-c8e083026a54 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616274 Nov 24 16:24:41.062562 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port be934a2b-3080-4139-8519-7b3fdd48d05e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:41.063714 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.228707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.275578 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:41.275839 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:24:41.279562 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-681113be-7d69-4a62-852f-e7cdd32ee3bd" -d '{"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:24:41.340387 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:24:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-88a2edb5-3e26-48b3-ab7d-b93db7d9c04e x-openstack-request-id: req-88a2edb5-3e26-48b3-ab7d-b93db7d9c04e {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:24:41.341006 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:24:41.341006 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-88a2edb5-3e26-48b3-ab7d-b93db7d9c04e {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:24:41.341396 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'code': 200} Nov 24 16:24:41.358029 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:41.416697 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=7']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:41.611747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9a8aa74c-7422-4d90-bc2d-24bf8d50817d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:41.689905 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd57c75b-ca6b-4539-a07c-59f61b55780d req-dea04287-9245-44d3-8940-5db524dca5a0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:41.708303 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dd57c75b-ca6b-4539-a07c-59f61b55780d req-dea04287-9245-44d3-8940-5db524dca5a0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0920546 Nov 24 16:24:41.759623 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Sync routers for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:24:41.770977 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db5cb2f4-28f5-44a0-8e72-14b0ac3cce9e req-628d132a-f88a-43e3-af90-ef5eb292f370 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:41.778929 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db5cb2f4-28f5-44a0-8e72-14b0ac3cce9e req-628d132a-f88a-43e3-af90-ef5eb292f370 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1690977 Nov 24 16:24:41.844915 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 49970) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:41.863123 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dd57c75b-ca6b-4539-a07c-59f61b55780d req-82ca3da4-bc30-4d08-a8cb-af90fc7c4730 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1532030 Nov 24 16:24:41.933632 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-db5cb2f4-28f5-44a0-8e72-14b0ac3cce9e req-38517927-cb57-4771-b62b-fb044e86febc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1482224 Nov 24 16:24:42.008529 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:42.015313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.017603 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:42.018536 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:42.138952 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-95d05662-d14f-487f-9d9a-872acef9e55f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.159754 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:24:42.384997 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-95d05662-d14f-487f-9d9a-872acef9e55f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.428033 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4837d985-fc85-43a4-bf37-26f223643535 req-36d9f883-0302-476b-a3e6-47a220f5b4f8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:42.435843 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4837d985-fc85-43a4-bf37-26f223643535 req-36d9f883-0302-476b-a3e6-47a220f5b4f8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.2720890 Nov 24 16:24:42.453137 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.474993 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:42.519522 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-95d05662-d14f-487f-9d9a-872acef9e55f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.566639 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4837d985-fc85-43a4-bf37-26f223643535 req-6d9d760d-1a7a-4a97-a563-cd9d289129cd tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1260054 Nov 24 16:24:42.617113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d05662-d14f-487f-9d9a-872acef9e55f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9dc2123-9437-42af-a790-ae365f90597c,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:42.623362 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-95d05662-d14f-487f-9d9a-872acef9e55f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a23b428639d940c3859e9072611f78d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7642772 Nov 24 16:24:42.627015 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 49986) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:42.631878 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:42.703482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.731033 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.733106 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.799047 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:42.884208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.888604 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:42.896416 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e9dc2123-9437-42af-a790-ae365f90597c HTTP/1.1" status: 204 len: 168 time: 0.2593305 Nov 24 16:24:42.934858 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c3a3b4-c323-4ddf-988d-81391b2ed12a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9dc2123-9437-42af-a790-ae365f90597c,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:42.960722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:39Z', 'revision_number': 4, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '689a2b14-53de-4fd4-8fb1-2b656a2f8db9', 'name': '', 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'mac_address': 'fa:16:3e:49:6d:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:38Z', 'updated_at': '2021-11-24T16:24:39Z', 'revision_number': 2, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'subnets': [{'id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:43.031242 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Checking router: 17c49c91-aac3-4197-b22c-97f1162ad379 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:24:43.031640 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Updating router 17c49c91-aac3-4197-b22c-97f1162ad379 port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:24:43.083190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.139583 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff7598dc-9178-443f-8d8f-aadfecdca812 req-28d0549b-72eb-451e-9294-a7d30757b115 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:43.146808 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ff7598dc-9178-443f-8d8f-aadfecdca812 req-28d0549b-72eb-451e-9294-a7d30757b115 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0945103 Nov 24 16:24:43.231271 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ff7598dc-9178-443f-8d8f-aadfecdca812 req-8bb04c55-677e-4a46-8616-044dc5d6ea48 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811124 Nov 24 16:24:43.677633 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9a8aa74c-7422-4d90-bc2d-24bf8d50817d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:43.813147 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.816939 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe44a67-a90b-4b72-bcc5-fea2252bc3ce req-060acfbd-71a1-4a0f-81ea-21a213dbe9f1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:43.824178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:43.824684 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:43.828972 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7fe44a67-a90b-4b72-bcc5-fea2252bc3ce req-060acfbd-71a1-4a0f-81ea-21a213dbe9f1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1200864 Nov 24 16:24:43.964628 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.003654 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7fe44a67-a90b-4b72-bcc5-fea2252bc3ce req-95bac858-72cb-4546-acfa-2859ee2075b1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1693490 Nov 24 16:24:44.080309 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128201fe-2b30-402d-901f-6024ce27786b None None] Pushing event updated for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:44.253533 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Attempting to bind port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:24:44.253886 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Attempting to bind port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:24:44.254294 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Attempting to bind port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 on network 4a5b2498-2d18-46a7-9cde-172882bf566d {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:24:44.288148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:24:44.290940 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Checking segment: {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:24:44.291611 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.292035 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Bound using segment: {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:24:44.302836 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Bound port: 689a2b14-53de-4fd4-8fb1-2b656a2f8db9, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eec903dc-62b4-41d9-ab39-748e8e72b762', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:24:44.302836 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.496136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] For port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:24:44.503895 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] For port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:24:44.514695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea97196-1f62-41f7-a92d-b6d72fd95e0e req-1bf535e7-e096-4178-b211-4d8ec9ed0681 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:44.522361 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2ea97196-1f62-41f7-a92d-b6d72fd95e0e req-1bf535e7-e096-4178-b211-4d8ec9ed0681 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0877099 Nov 24 16:24:44.619700 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.620190 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2ea97196-1f62-41f7-a92d-b6d72fd95e0e req-8ee6aabc-33c1-47d9-8d5d-010d8125db5e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0893736 Nov 24 16:24:44.743625 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] Provisioning complete for port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:44.743625 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:44.874476 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:24:44.878334 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:24:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:44.880100 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128201fe-2b30-402d-901f-6024ce27786b None None] Pushing event updated for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:45.193891 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:24:45.217208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc56390-5a84-4eec-9619-424328b637b9 req-27e4b6eb-0d60-4b97-b5db-3eb1639b97fb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:45.226691 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbc56390-5a84-4eec-9619-424328b637b9 req-27e4b6eb-0d60-4b97-b5db-3eb1639b97fb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0809762 Nov 24 16:24:45.292681 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.332322 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cbc56390-5a84-4eec-9619-424328b637b9 req-8930eae4-f368-47e8-ab80-6e1168a234fe tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1045957 Nov 24 16:24:45.379009 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] For port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:24:45.451857 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.544532 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61c6b47-7332-4ef0-ae6b-5eb3abfaf4d7 None None] Pushing event updated for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:45.622991 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-4a26d2bc-1781-4d94-9cbb-098506c1260d None None] Provisioning complete for port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:45.622991 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4a26d2bc-1781-4d94-9cbb-098506c1260d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:45.782939 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:39Z', 'revision_number': 4, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '689a2b14-53de-4fd4-8fb1-2b656a2f8db9', 'name': '', 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'mac_address': 'fa:16:3e:49:6d:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:38Z', 'updated_at': '2021-11-24T16:24:44Z', 'revision_number': 4, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'subnets': [{'id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:24:45.824410 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3230c074-97f9-4a23-a086-104f27b13933 None None] The sync data for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi is: [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:24:39Z', 'revision_number': 4, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '689a2b14-53de-4fd4-8fb1-2b656a2f8db9', 'name': '', 'network_id': '4a5b2498-2d18-46a7-9cde-172882bf566d', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'mac_address': 'fa:16:3e:49:6d:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:38Z', 'updated_at': '2021-11-24T16:24:44Z', 'revision_number': 4, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'subnets': [{'id': '78fefca8-6dfc-4d51-afa6-7531a69831e6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:24:45.911906 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12031e3b-7989-4c08-8fb6-9841ae776927 req-f8b9c4c7-274d-4f42-b0b3-a543df67989b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:45.920150 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-12031e3b-7989-4c08-8fb6-9841ae776927 req-f8b9c4c7-274d-4f42-b0b3-a543df67989b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.1239083 Nov 24 16:24:46.001891 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-12031e3b-7989-4c08-8fb6-9841ae776927 req-766ae71d-1fb6-4e3e-98b8-087dfa7426ce tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0801358 Nov 24 16:24:46.488090 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991c9f2e-880a-4f68-b2ef-433fa9718a2f req-28a717a2-1d02-416d-8138-103caf2521a0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:46.489694 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-991c9f2e-880a-4f68-b2ef-433fa9718a2f req-28a717a2-1d02-416d-8138-103caf2521a0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0517125 Nov 24 16:24:46.543836 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-991c9f2e-880a-4f68-b2ef-433fa9718a2f req-a60b7a79-e475-41f7-9d4e-dbeb3792aa1c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476940 Nov 24 16:24:46.658051 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519f3474-822a-420e-9961-3650202547bc req-1fcd9e76-b257-44c1-b121-377bb1eee05e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:46.659712 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-1fcd9e76-b257-44c1-b121-377bb1eee05e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1099 time: 0.0516512 Nov 24 16:24:46.766730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519f3474-822a-420e-9961-3650202547bc req-1f865764-be64-44d7-a178-773e2cba4d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:46.768362 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-1f865764-be64-44d7-a178-773e2cba4d19 service neutron] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 911 time: 0.0965521 Nov 24 16:24:46.892564 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-06bec6ef-3403-4acd-a91b-47245c492abc service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 1001 time: 0.1046207 Nov 24 16:24:46.963705 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-45cece1e-94e6-403a-aaa9-7ce93fe6aed3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:46.992348 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519f3474-822a-420e-9961-3650202547bc req-251bac12-a506-4ccc-902b-288b5e9c59ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:46.995367 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-251bac12-a506-4ccc-902b-288b5e9c59ea service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.0839188 Nov 24 16:24:47.051551 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519f3474-822a-420e-9961-3650202547bc req-feb96ce1-a12d-4128-bbd2-3fc71a9dcc21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:47.053651 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-feb96ce1-a12d-4128-bbd2-3fc71a9dcc21 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0490220 Nov 24 16:24:47.279675 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f24fb5-8e9f-448b-bab8-a8c48169325c req-0e8ce24a-8db3-4eb2-93c7-afa36f342c13 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:47.287027 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1f24fb5-8e9f-448b-bab8-a8c48169325c req-0e8ce24a-8db3-4eb2-93c7-afa36f342c13 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0960805 Nov 24 16:24:47.299137 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-ac5295a1-9f91-49bf-b9e2-6de3ae42ca8a service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2344651 Nov 24 16:24:47.389948 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1f24fb5-8e9f-448b-bab8-a8c48169325c req-599620e0-648d-4c5e-88a9-a2c417f8d9db tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1019807 Nov 24 16:24:47.557229 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-519f3474-822a-420e-9961-3650202547bc req-94c81e43-d785-4cfa-8471-9566174677ee service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1727462 Nov 24 16:24:47.651750 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:24:47.803210 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddeab5a9-1987-4402-bc30-ebb958a5455b req-f0587315-5ae9-4c4d-ad80-37436181347a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:47.808936 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:24:47.809511 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:47.813061 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ddeab5a9-1987-4402-bc30-ebb958a5455b req-f0587315-5ae9-4c4d-ad80-37436181347a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1118059 Nov 24 16:24:47.938704 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ddeab5a9-1987-4402-bc30-ebb958a5455b req-5e42c19a-97df-4998-be40-3d7770b5b80f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1194253 Nov 24 16:24:48.596157 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79d0945-697c-400f-80c7-15fddab378c1 req-72ce444b-dfe0-4410-902e-9154991d0090 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:48.597565 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c79d0945-697c-400f-80c7-15fddab378c1 req-72ce444b-dfe0-4410-902e-9154991d0090 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0815005 Nov 24 16:24:48.700796 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c79d0945-697c-400f-80c7-15fddab378c1 req-1a2b4d20-52cd-4fc3-86b4-53a451aa2ae8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0904269 Nov 24 16:24:49.094887 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650a8a43-457d-4f72-b6a2-8fb2334bc0ff req-fc2fb547-49cd-46d5-b00e-36d3f9bf95a0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:49.106761 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-650a8a43-457d-4f72-b6a2-8fb2334bc0ff req-fc2fb547-49cd-46d5-b00e-36d3f9bf95a0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0884404 Nov 24 16:24:49.200130 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-650a8a43-457d-4f72-b6a2-8fb2334bc0ff req-b962a547-f370-43df-81a6-48df1185d18d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0921907 Nov 24 16:24:49.297988 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-315b2fa5-fb7e-4ddb-aac6-3f18564c0f71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:50.023716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85320b96-0795-4b1f-a3d4-3f1335b0388b req-48c701c6-c478-4862-a41f-27c18e25367c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:50.045018 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-85320b96-0795-4b1f-a3d4-3f1335b0388b req-48c701c6-c478-4862-a41f-27c18e25367c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.1993299 Nov 24 16:24:50.239587 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-85320b96-0795-4b1f-a3d4-3f1335b0388b req-5036da48-ffe2-4864-8e5c-0933910fa750 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1922321 Nov 24 16:24:50.467953 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:51.353656 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751f2885-bbfa-4f9c-9d7d-44e9b7916ff7 req-613fe9c0-beeb-4954-91e5-fde61c9fba29 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:51.355141 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-751f2885-bbfa-4f9c-9d7d-44e9b7916ff7 req-613fe9c0-beeb-4954-91e5-fde61c9fba29 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0531502 Nov 24 16:24:51.405937 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-751f2885-bbfa-4f9c-9d7d-44e9b7916ff7 req-fb8ad52f-8b1a-41d3-a896-fa9ea9db1580 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447023 Nov 24 16:24:51.717057 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:52.425408 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:52.637582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38271a61-7498-4adf-9fd7-07afcd794faf req-8c39fd0c-3230-400c-a5c6-24934a219ca7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:52.651675 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38271a61-7498-4adf-9fd7-07afcd794faf req-8c39fd0c-3230-400c-a5c6-24934a219ca7 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.1278186 Nov 24 16:24:52.750961 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38271a61-7498-4adf-9fd7-07afcd794faf req-d26df8dc-7576-4369-804f-693716787e7d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0881703 Nov 24 16:24:53.969347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2d91d1-12a9-4f12-b25a-6cfb0c3649a8 req-37159484-4dd8-4580-91d7-065d656b6555 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:53.970945 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3d2d91d1-12a9-4f12-b25a-6cfb0c3649a8 req-37159484-4dd8-4580-91d7-065d656b6555 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0821157 Nov 24 16:24:54.094498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9777417-9019-43a2-a945-7939581c02cd req-e411aeaf-50b1-4d6b-a0cc-03b4911bf685 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:54.099429 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3d2d91d1-12a9-4f12-b25a-6cfb0c3649a8 req-834d7c39-757b-4ec9-9e46-225ee54d2dfe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1055365 Nov 24 16:24:54.119787 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c9777417-9019-43a2-a945-7939581c02cd req-e411aeaf-50b1-4d6b-a0cc-03b4911bf685 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1307528 Nov 24 16:24:54.120582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-2abbad20-2e0c-4a3d-98d9-8004383ad354 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:54.122355 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-2abbad20-2e0c-4a3d-98d9-8004383ad354 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0946844 Nov 24 16:24:54.273679 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c9777417-9019-43a2-a945-7939581c02cd req-a9027304-28b3-46bf-9d57-b958d772b725 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349039 Nov 24 16:24:54.273785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-b5ea0c18-cde7-4ca4-9362-a30dd715f186 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:54.273785 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-b5ea0c18-cde7-4ca4-9362-a30dd715f186 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.1386604 Nov 24 16:24:54.345222 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-676bee62-d803-4976-bfdc-6fcdc51569b5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0605688 Nov 24 16:24:54.520905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-4eab3b30-daba-4995-921f-a75a5b59fe10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:54.522404 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-4eab3b30-daba-4995-921f-a75a5b59fe10 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.1670024 Nov 24 16:24:54.595507 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-da803a22-6827-4a73-9728-bb00813431bb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0653152 Nov 24 16:24:54.966469 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-a770baa7-dced-4b2d-b58b-be61769b5be8 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3626435 Nov 24 16:24:55.069454 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3fd9b7dc-4814-4f2e-98e0-66961a574e41 req-a1751354-c213-4308-b411-613f325dd396 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0933530 Nov 24 16:24:55.238949 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ca5b4a-2383-4428-8f66-b36b28582caa req-eefa044a-3afd-4bba-85e7-e6e916aa2cc2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:55.240428 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-89ca5b4a-2383-4428-8f66-b36b28582caa req-eefa044a-3afd-4bba-85e7-e6e916aa2cc2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0521843 Nov 24 16:24:55.304553 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-89ca5b4a-2383-4428-8f66-b36b28582caa req-a42b3f66-a9d9-4deb-8254-b3e5b5099fe8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0571082 Nov 24 16:24:55.390136 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4c7eb-d4e5-4f70-aa60-efdbe58a7587 req-16e39c55-0c97-4bdd-b955-319818517e84 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:55.391640 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-56e4c7eb-d4e5-4f70-aa60-efdbe58a7587 req-16e39c55-0c97-4bdd-b955-319818517e84 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0633864 Nov 24 16:24:55.450982 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-56e4c7eb-d4e5-4f70-aa60-efdbe58a7587 req-0803fb9e-11b1-427d-b184-1bd4439e180e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431347 Nov 24 16:24:56.448314 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5382fc7-0d45-4a0a-a328-0fc1667681cb req-01ba3652-0207-4842-b69c-0cf2d96e99e1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:56.448314 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c5382fc7-0d45-4a0a-a328-0fc1667681cb req-01ba3652-0207-4842-b69c-0cf2d96e99e1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0518177 Nov 24 16:24:56.485691 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c5382fc7-0d45-4a0a-a328-0fc1667681cb req-2b9d19e7-572c-4faf-beca-6d5733d9b9d2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431907 Nov 24 16:24:56.596017 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0701d38-74ca-4f0f-85e1-7bf85a41b18b req-75faf2e4-dd64-449f-873f-456e5f8381ed tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:56.598323 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e0701d38-74ca-4f0f-85e1-7bf85a41b18b req-75faf2e4-dd64-449f-873f-456e5f8381ed tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0578654 Nov 24 16:24:56.651389 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e0701d38-74ca-4f0f-85e1-7bf85a41b18b req-a70d9e43-18b3-4963-9f3e-e32e50a50bf3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462339 Nov 24 16:24:57.609400 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb997b1-0399-4dc2-bce5-10bf0e050122 req-ba6e6523-52f4-426a-82f5-4e8d0e4ac503 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:57.610947 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6fb997b1-0399-4dc2-bce5-10bf0e050122 req-ba6e6523-52f4-426a-82f5-4e8d0e4ac503 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0490904 Nov 24 16:24:57.644201 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-46d1e4e1-bb2b-41c9-a870-d63cbba253b9 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:57.645789 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-46d1e4e1-bb2b-41c9-a870-d63cbba253b9 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 815 time: 0.1039331 Nov 24 16:24:57.663433 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6fb997b1-0399-4dc2-bce5-10bf0e050122 req-a7110b5c-fe4d-4f7c-9153-a8fa2cd49d37 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460069 Nov 24 16:24:57.667277 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-5269fe1c-670c-43e7-ad43-7a88d4744d02 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/quotas/4562b21a9bec4777b36baec6291778f5 HTTP/1.1" status: 200 len: 375 time: 0.0109692 Nov 24 16:24:57.725909 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-c77639b5-435c-400a-8d5f-c88fe72b0d1a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0556610 Nov 24 16:24:57.796785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d73efb-5b25-49ec-bb7f-fedb67bdd3ba req-96d8d253-acf8-48c6-9cb4-8e7c745b2328 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:57.800038 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-73d73efb-5b25-49ec-bb7f-fedb67bdd3ba req-96d8d253-acf8-48c6-9cb4-8e7c745b2328 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0498097 Nov 24 16:24:57.823999 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-29220cbc-0689-4a86-a286-bf844eb498c7 service neutron] 10.222.0.82 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843387 Nov 24 16:24:57.846784 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-73d73efb-5b25-49ec-bb7f-fedb67bdd3ba req-85214f78-90ec-4564-a231-1aeab7dee780 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418086 Nov 24 16:24:57.920678 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-5dbf0639-773d-4c61-9afe-b30fdd9fa9ce service neutron] 10.222.0.82 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894403 Nov 24 16:24:57.980426 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-04efb1d9-0f55-445f-9c65-d2fd2720d4de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:57.990405 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-04efb1d9-0f55-445f-9c65-d2fd2720d4de service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1099 time: 0.0518007 Nov 24 16:24:58.078486 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-1aad77a5-b11f-45b1-ac30-c2b60f0ac367 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:58.079868 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-1aad77a5-b11f-45b1-ac30-c2b60f0ac367 service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.0889416 Nov 24 16:24:58.147701 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-a7d82982-eb2e-473d-bbc8-1921ae0e45df service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 1002 time: 0.0582259 Nov 24 16:24:58.247266 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f3959ed0-6978-415d-8b51-02b698ef662f req-bd364cbf-7de5-446c-9c16-1588bdd08319 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 210 time: 0.0365126 Nov 24 16:24:58.251397 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-cf492705-4565-4bb8-b218-9c7327fb569c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:58.252972 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-cf492705-4565-4bb8-b218-9c7327fb569c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0915103 Nov 24 16:24:58.307429 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-b7ec8412-7d84-4491-b987-41060dc8e2bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:58.308984 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-b7ec8412-7d84-4491-b987-41060dc8e2bd service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0475404 Nov 24 16:24:58.384431 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 50254) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:58.406693 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-cfce0c1c-09de-4bf4-8347-7f11aca9107e service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885854 Nov 24 16:24:58.502610 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-457e3bcd-d316-4e2d-91c5-314ae0e40ff6 req-bfa28f8f-6df0-442b-b3e1-ee01f893135f service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860174 Nov 24 16:24:58.528038 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-448cd500-84ee-44aa-b7f1-7875de97ab2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.672220 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.700967 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-448cd500-84ee-44aa-b7f1-7875de97ab2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.769198 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-448cd500-84ee-44aa-b7f1-7875de97ab2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.817239 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-448cd500-84ee-44aa-b7f1-7875de97ab2a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=23c534d852e0419b83c0a6b942bd0326&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4316266 Nov 24 16:24:58.820070 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 50264) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:24:58.821184 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-448cd500-84ee-44aa-b7f1-7875de97ab2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b62108b-6e35-4de3-a688-b2434e673427,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:58.832080 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ce1352-af38-4c14-9bb8-28e9685a392b req-dc8dc601-ece9-4721-9f1a-84bba23bd164 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:58.833589 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-95ce1352-af38-4c14-9bb8-28e9685a392b req-dc8dc601-ece9-4721-9f1a-84bba23bd164 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0925381 Nov 24 16:24:58.890290 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.891768 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-95ce1352-af38-4c14-9bb8-28e9685a392b req-108260c3-880b-46d3-ab50-635938386147 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490100 Nov 24 16:24:58.921589 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:58.993247 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee48aa40-3298-4136-b3a9-28f0f9aa748a req-16df43a3-773f-4067-af88-f859d013213d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:24:58.994730 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ee48aa40-3298-4136-b3a9-28f0f9aa748a req-16df43a3-773f-4067-af88-f859d013213d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0590558 Nov 24 16:24:59.042674 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ee48aa40-3298-4136-b3a9-28f0f9aa748a req-2c1f7ab2-b40e-4121-af21-a5806c5d0c87 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417416 Nov 24 16:24:59.043714 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:59.046257 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:24:59.047329 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8b62108b-6e35-4de3-a688-b2434e673427 HTTP/1.1" status: 204 len: 168 time: 0.2260811 Nov 24 16:24:59.056740 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea23bff0-6b95-45db-b7d1-3437c4d32ad1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b62108b-6e35-4de3-a688-b2434e673427,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:24:59.340109 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-909bceb4-8d85-41e0-945a-7db717b06e0e req-c28d684d-bdc9-47fc-a012-d21db5c37c83 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 210 time: 0.0269408 Nov 24 16:25:00.017113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afee1e30-b875-4c4a-9895-3d12ca018ccf req-30cb1d38-3a61-4b64-92f5-a0a5dfb783a0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:00.018765 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-afee1e30-b875-4c4a-9895-3d12ca018ccf req-30cb1d38-3a61-4b64-92f5-a0a5dfb783a0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0498083 Nov 24 16:25:00.041536 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 50294) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:00.066073 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-afee1e30-b875-4c4a-9895-3d12ca018ccf req-951513e1-2a50-4d4c-8f2c-cd611d312cf4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409908 Nov 24 16:25:00.143164 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1483097923-network', 'tenant_id': '321dd686a448414493dd3fa5f4429d91'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:00.175381 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bba9d2a-df0d-4cbd-8c77-6546bdf678b8 req-2818dce6-a94c-4a5d-bf8c-7ccc7c704bdc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:00.176871 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5bba9d2a-df0d-4cbd-8c77-6546bdf678b8 req-2818dce6-a94c-4a5d-bf8c-7ccc7c704bdc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0652754 Nov 24 16:25:00.232010 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5bba9d2a-df0d-4cbd-8c77-6546bdf678b8 req-d682fe76-c82f-44ab-90f8-1e03597a06af tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484555 Nov 24 16:25:00.233055 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Made reservation on behalf of 321dd686a448414493dd3fa5f4429d91 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:25:00.235254 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.244982 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.321308 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.363219 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.386422 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 856} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:25:00.400916 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2ae54f5-d105-4b6a-a72b-10c65427b833,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:00.405908 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.406254 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Added segment 05c68f21-b538-4544-a014-1cd8d8520388 of type vlan for network 796ec630-98f3-43e7-992a-da71da73d27a Nov 24 16:25:00.451522 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.464214 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38ff742b-13b3-4480-a858-87df7c8568fd req-85c135db-a9bb-4ce1-b3f7-f7ba92790f62 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 210 time: 0.0532100 Nov 24 16:25:00.514187 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-766f666d-9f7c-40b4-bd1a-e4ad09f89e31 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:00.515746 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-766f666d-9f7c-40b4-bd1a-e4ad09f89e31 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 815 time: 0.1453731 Nov 24 16:25:00.533462 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'port': {'device_id': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'admin_state_up': True, 'tenant_id': '4562b21a9bec4777b36baec6291778f5'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:00.569050 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.570871 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:00.571834 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.633187 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] Pushing event updated for resources: {'Network': ['ID=796ec630-98f3-43e7-992a-da71da73d27a,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:00.642982 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 796ec630-98f3-43e7-992a-da71da73d27a details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:25:00.680513 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-15133c81-babd-405d-9eb3-f36d0934ba9e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6378610 Nov 24 16:25:00.684275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 50302) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:00.692249 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Request body: {'subnet': {'network_id': '796ec630-98f3-43e7-992a-da71da73d27a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1483097923-subnet', 'tenant_id': '321dd686a448414493dd3fa5f4429d91', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:00.776136 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Made reservation on behalf of 4562b21a9bec4777b36baec6291778f5 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:25:00.779736 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.889377 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Made reservation on behalf of 321dd686a448414493dd3fa5f4429d91 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:25:00.891678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25215965'] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:00.968721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Allocated IP 172.20.0.12 (3244fb11-f411-4a53-b3cf-8285d8f01d99/32dfcce0-5f9f-4b5c-b446-29700080ce52/4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:25:01.064295 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:25:01.173858 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.228392 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:01.230547 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:01.235411 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-010f3ad7-d0b1-4a5c-8007-6dc7b93c390a" -d '{"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-unplugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:01.239225 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6490028-e566-4951-824c-0dad338e0c72 req-eec5b4e3-ed4a-4bc1-9f32-bd2bfedb216e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:01.240755 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d6490028-e566-4951-824c-0dad338e0c72 req-eec5b4e3-ed4a-4bc1-9f32-bd2bfedb216e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 946 time: 0.0589142 Nov 24 16:25:01.251709 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.279047 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6a0cf77-16bb-415a-b3e3-6d06baddd4a2 x-openstack-request-id: req-d6a0cf77-16bb-415a-b3e3-6d06baddd4a2 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:01.279047 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-unplugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:01.279047 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d6a0cf77-16bb-415a-b3e3-6d06baddd4a2 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:01.279047 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'code': 200} Nov 24 16:25:01.294507 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d6490028-e566-4951-824c-0dad338e0c72 req-b20445a0-116c-482b-97d6-ce9215c97ee9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456324 Nov 24 16:25:01.314775 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-26164714', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25215951'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.346564 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.402074 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.420985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6aa9b822-d992-4b52-b747-b04d55bff714,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:01.453265 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=8']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:01.454558 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Checking segment: {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:25:01.455027 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Network hostable DHCP agents. Network: 796ec630-98f3-43e7-992a-da71da73d27a, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:25:01.500957 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1183581f-16dc-4802-b24a-dea7922f5872 req-f55658fa-2582-4a94-a8ea-78ffa8f0f7d2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:01.500957 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1183581f-16dc-4802-b24a-dea7922f5872 req-f55658fa-2582-4a94-a8ea-78ffa8f0f7d2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1669872 Nov 24 16:25:01.533564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:25:01.555186 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:25:01.560832 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:25:01.584819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:01.665886 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:01.666698 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.696744 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1183581f-16dc-4802-b24a-dea7922f5872 req-2de428c0-294e-4f46-9c09-69916dd1a436 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1686175 Nov 24 16:25:01.717266 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Network 796ec630-98f3-43e7-992a-da71da73d27a is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:25:01.776374 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-2eb63d95-d8fe-4885-98c9-81e99be6678c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2464807 Nov 24 16:25:01.826689 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 796ec630-98f3-43e7-992a-da71da73d27a) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:25:01.831273 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:01.831981 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:01.841163 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-763d80a4-5d37-425f-8b00-e8ddd3b4bc47 None None] Network 796ec630-98f3-43e7-992a-da71da73d27a requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:25:01.976328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8cd01e-b1c7-48f1-8bac-e288bd75b2c5 req-81865133-984b-4d2d-a19b-2e620f4f7bbc tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:01.987502 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2d8cd01e-b1c7-48f1-8bac-e288bd75b2c5 req-81865133-984b-4d2d-a19b-2e620f4f7bbc tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.1513934 Nov 24 16:25:02.005993 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3679c066-79e7-4bb0-ad80-c89173d3f704 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.3204055 Nov 24 16:25:02.025224 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-d054c3b7-40b4-448c-a62d-1afdab49d093 None None] Provisioning complete for port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:25:02.025875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d054c3b7-40b4-448c-a62d-1afdab49d093 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:02.074582 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2d8cd01e-b1c7-48f1-8bac-e288bd75b2c5 req-31688763-97db-471c-888f-f9cf89ecddd5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798147 Nov 24 16:25:02.170877 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-d054c3b7-40b4-448c-a62d-1afdab49d093 None None] Port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:25:02.176728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-829143c1-57b6-4a7b-9725-37be32869c3e None None] Network 796ec630-98f3-43e7-992a-da71da73d27a requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:25:02.842844 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7fde5d-525a-4000-8c84-cb934178da5e req-73d8a379-1e6f-46c0-ba75-e37d967895a5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:02.847404 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2c7fde5d-525a-4000-8c84-cb934178da5e req-73d8a379-1e6f-46c0-ba75-e37d967895a5 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0592039 Nov 24 16:25:02.920544 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2c7fde5d-525a-4000-8c84-cb934178da5e req-eaaaa13e-bc6e-49c9-8a34-b9c5edcdad5a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688126 Nov 24 16:25:02.976963 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [req-e16f01cd-ff07-4e01-932e-54cc25b4b157 req-4130e192-8d5e-46c3-87eb-577b743330a0 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:25:02.981372 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e16f01cd-ff07-4e01-932e-54cc25b4b157 req-4130e192-8d5e-46c3-87eb-577b743330a0 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058880 Nov 24 16:25:03.253005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612eed70-98a9-45b6-92dd-cdc046cee73d req-36290306-1daf-4ff0-90e8-99735fb554bf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:03.267492 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-612eed70-98a9-45b6-92dd-cdc046cee73d req-36290306-1daf-4ff0-90e8-99735fb554bf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.1051676 Nov 24 16:25:03.356834 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-612eed70-98a9-45b6-92dd-cdc046cee73d req-0331b410-0779-486e-8138-4867bf80a31a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799325 Nov 24 16:25:03.437029 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7ccfa4-735c-4b61-9541-5564960416ed req-66312fd3-7f2c-43b0-91da-9cdd67f89f00 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:03.446175 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fe7ccfa4-735c-4b61-9541-5564960416ed req-66312fd3-7f2c-43b0-91da-9cdd67f89f00 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0697663 Nov 24 16:25:03.517089 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fe7ccfa4-735c-4b61-9541-5564960416ed req-c153fbdd-12f7-4378-acb1-a58d0f289460 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0693529 Nov 24 16:25:04.027364 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 50396) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:04.045990 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9241c4eb-b019-46f7-90d0-718f00d1cb61 req-d8b34c58-7306-43b3-9c70-ea4cd794598d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:04.048637 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9241c4eb-b019-46f7-90d0-718f00d1cb61 req-d8b34c58-7306-43b3-9c70-ea4cd794598d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0559869 Nov 24 16:25:04.117251 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9241c4eb-b019-46f7-90d0-718f00d1cb61 req-297c3231-76fd-4adf-8080-0cac2fbfb6b4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619369 Nov 24 16:25:04.163747 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-b0e8e1b4-2b1f-430e-bef7-92c83879b94a service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1352146 Nov 24 16:25:04.174529 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-0e7fdb69-4860-479c-bb41-4d9eccf62b68 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103141) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:25:04.175550 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-0e7fdb69-4860-479c-bb41-4d9eccf62b68 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051460 Nov 24 16:25:04.436576 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-18f5f6ba-798d-4093-8f7d-d057c3212b94 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:04.438042 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-18f5f6ba-798d-4093-8f7d-d057c3212b94 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/networks?id=796ec630-98f3-43e7-992a-da71da73d27a HTTP/1.1" status: 200 len: 814 time: 0.1259687 Nov 24 16:25:04.455974 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-46cea448-07f0-42d6-9707-98e8f48b92e6 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/quotas/321dd686a448414493dd3fa5f4429d91 HTTP/1.1" status: 200 len: 375 time: 0.0104685 Nov 24 16:25:04.493601 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb9d776-2675-4000-8d5a-51a29f707275 req-ea260467-a209-4fbf-a856-3db987597704 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:04.495138 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ecb9d776-2675-4000-8d5a-51a29f707275 req-ea260467-a209-4fbf-a856-3db987597704 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0632322 Nov 24 16:25:04.501001 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-6e3a3d33-113c-45f1-8bcb-799ba75cd4dc tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0326414 Nov 24 16:25:04.552670 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ecb9d776-2675-4000-8d5a-51a29f707275 req-b60244eb-431f-48b1-81a7-79f674c44975 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485642 Nov 24 16:25:04.613423 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-552924e4-6af9-4254-8779-37a0aa97b82e service neutron] 10.222.0.82 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1041887 Nov 24 16:25:04.701751 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b35f2911-7c2e-494e-92b6-42c75301359b req-872138fe-ff28-4e74-be16-477093886078 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:04.709781 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b35f2911-7c2e-494e-92b6-42c75301359b req-872138fe-ff28-4e74-be16-477093886078 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0894670 Nov 24 16:25:04.771690 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b35f2911-7c2e-494e-92b6-42c75301359b req-7f8cf6e0-bb6b-4aec-a1d0-b4be6fafdcbc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0603557 Nov 24 16:25:04.795306 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-faea4b89-6d25-4cb2-9298-04e5bf89f2bd service neutron] 10.222.0.82 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1683154 Nov 24 16:25:05.045169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0fcf664e-044e-4f8e-9197-f9409d77672b req-3558796c-9f76-4da2-a42b-7aea0c56a853 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0273223 Nov 24 16:25:05.245597 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0048e7b8-db9d-49d8-a78c-d807710fc1ae req-e4e7af39-39fa-4b2e-abaf-327ae349a91b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:05.247618 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0048e7b8-db9d-49d8-a78c-d807710fc1ae req-e4e7af39-39fa-4b2e-abaf-327ae349a91b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0505004 Nov 24 16:25:05.302372 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0048e7b8-db9d-49d8-a78c-d807710fc1ae req-5acfb831-a1a0-498d-8339-fd0e947ae0cf tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491087 Nov 24 16:25:05.331112 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:25:05.681884 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e30b447-e3f0-4041-b1f1-ba215835740c req-52dce1e4-f2b1-41f0-b6ec-587f2645fbeb tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:05.683647 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3e30b447-e3f0-4041-b1f1-ba215835740c req-52dce1e4-f2b1-41f0-b6ec-587f2645fbeb tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0574222 Nov 24 16:25:05.738007 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3e30b447-e3f0-4041-b1f1-ba215835740c req-0fee79a7-67d4-495f-8ee8-5e742b2fa672 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476687 Nov 24 16:25:05.900673 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899d193-b7b2-4e1d-86b2-3b2761cdc6df req-3ba13879-2f2d-49ad-b3a4-c2c80afccf34 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:05.902171 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f899d193-b7b2-4e1d-86b2-3b2761cdc6df req-3ba13879-2f2d-49ad-b3a4-c2c80afccf34 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0512729 Nov 24 16:25:05.951263 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f899d193-b7b2-4e1d-86b2-3b2761cdc6df req-c349752f-1f0b-4e8a-9bf4-ce88b449cd2a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429788 Nov 24 16:25:06.144398 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7055d4ec-866f-452f-ae9b-af8483ec0d24 req-f93aad01-5509-42d8-a246-4ef1b88ca669 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0263846 Nov 24 16:25:06.428290 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0326878-c005-480f-854f-0e3291a1c5e2 req-162a8a7b-7b0c-4cb7-b9e9-03b13a34964b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:06.430418 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a0326878-c005-480f-854f-0e3291a1c5e2 req-162a8a7b-7b0c-4cb7-b9e9-03b13a34964b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0589037 Nov 24 16:25:06.480993 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a0326878-c005-480f-854f-0e3291a1c5e2 req-26d760f2-9072-47be-84bb-d2bc84661782 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445838 Nov 24 16:25:06.863072 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da820ca-4e77-4b63-bdab-1cf6455c0e79 req-974366dd-fd1e-4b76-a1c1-9f0bd0e99572 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:06.864562 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5da820ca-4e77-4b63-bdab-1cf6455c0e79 req-974366dd-fd1e-4b76-a1c1-9f0bd0e99572 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0532527 Nov 24 16:25:06.917353 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5da820ca-4e77-4b63-bdab-1cf6455c0e79 req-353d410d-9c4f-4620-b284-e838d14edaf9 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468965 Nov 24 16:25:07.076103 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a974ca-a945-4fec-b3ee-9caa0dcf8fa1 req-d6192106-71ad-4a97-8d2e-76ada941672c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:07.077515 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-43a974ca-a945-4fec-b3ee-9caa0dcf8fa1 req-d6192106-71ad-4a97-8d2e-76ada941672c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0555642 Nov 24 16:25:07.126558 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-43a974ca-a945-4fec-b3ee-9caa0dcf8fa1 req-71b4f245-cb96-4390-97f1-287dfa2a1a65 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432613 Nov 24 16:25:07.236113 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f0f82008-6650-4c8e-a03e-2be94c4bc4d1 req-52f45f60-2d50-47d8-9424-1b9eb362f7f0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0250721 Nov 24 16:25:07.603344 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73dba206-8ca8-4af7-9771-38f27444762f req-fc4b1730-2caf-4486-9c3f-84601c4cd45a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:07.604839 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-73dba206-8ca8-4af7-9771-38f27444762f req-fc4b1730-2caf-4486-9c3f-84601c4cd45a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0531335 Nov 24 16:25:07.653408 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-73dba206-8ca8-4af7-9771-38f27444762f req-076ba120-a8fd-411b-94f4-dc779f3eb1e0 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421438 Nov 24 16:25:08.037940 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1935d3f1-10c7-48b0-b912-b673227e3933 req-1ac70cd6-1502-4f0b-a530-c72d64f4fafd tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:08.039549 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1935d3f1-10c7-48b0-b912-b673227e3933 req-1ac70cd6-1502-4f0b-a530-c72d64f4fafd tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0529053 Nov 24 16:25:08.087953 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1935d3f1-10c7-48b0-b912-b673227e3933 req-98520d80-f1be-407d-9374-0f2155d965b4 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423801 Nov 24 16:25:08.251470 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a135f2-3189-43bf-84ba-0454b24026aa req-03562556-987f-4bd6-b97c-be7501b555e6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:08.252970 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8a135f2-3189-43bf-84ba-0454b24026aa req-03562556-987f-4bd6-b97c-be7501b555e6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0494170 Nov 24 16:25:08.303691 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8a135f2-3189-43bf-84ba-0454b24026aa req-da601e99-4789-455a-9d16-03cc5b954d2f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442839 Nov 24 16:25:08.332394 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5ca372e6-d74c-4c88-9e93-133f44f7eac5 req-9c6914cf-9a21-4a75-8cd5-1ed0b8e44231 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0278261 Nov 24 16:25:08.779627 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d4209e4-2cd6-4592-95b0-c13aeef01021 req-038b662a-6113-47dd-ae25-0b506a7e77f3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:08.781136 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4d4209e4-2cd6-4592-95b0-c13aeef01021 req-038b662a-6113-47dd-ae25-0b506a7e77f3 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0557125 Nov 24 16:25:08.841498 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4d4209e4-2cd6-4592-95b0-c13aeef01021 req-c0749873-4dd2-4ed2-a7d0-c78ee5b7a18b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539083 Nov 24 16:25:09.203060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d16c36-1e0f-41d0-8dee-2fb7fcbd363f req-82f2bcf0-484d-4904-b5ca-61f811c7c102 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:09.204553 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e0d16c36-1e0f-41d0-8dee-2fb7fcbd363f req-82f2bcf0-484d-4904-b5ca-61f811c7c102 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0505843 Nov 24 16:25:09.252550 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e0d16c36-1e0f-41d0-8dee-2fb7fcbd363f req-2686e9a2-0461-437d-b600-8d79f3be634c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418947 Nov 24 16:25:09.441913 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528704e0-4ce8-4d76-9456-c072075d9312 req-adb9ca68-63cd-49f8-b3c3-64af6752d440 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:09.443424 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-528704e0-4ce8-4d76-9456-c072075d9312 req-adb9ca68-63cd-49f8-b3c3-64af6752d440 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0532913 Nov 24 16:25:09.459508 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-deb335d4-67b8-4b9d-b092-00e4c1bbc31b req-e710347f-98fa-44ca-b0fa-ca514ec48537 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0341897 Nov 24 16:25:09.499041 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-528704e0-4ce8-4d76-9456-c072075d9312 req-4031c8b1-36db-4458-8f5f-63485e54a7f6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496907 Nov 24 16:25:09.969187 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-429197b6-d88c-40f8-9274-29aad6668381 req-f36c27e3-b1f1-4660-9cfd-218a708484ef tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:09.970730 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-429197b6-d88c-40f8-9274-29aad6668381 req-f36c27e3-b1f1-4660-9cfd-218a708484ef tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0517454 Nov 24 16:25:10.027658 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-429197b6-d88c-40f8-9274-29aad6668381 req-3db6f781-46d4-4470-b354-3b70c4cdb774 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506911 Nov 24 16:25:10.393666 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65fe9455-4839-45d6-b348-201235ea81f7 req-13b4369e-bf94-4432-ba58-4939af4bc5b7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:10.393666 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65fe9455-4839-45d6-b348-201235ea81f7 req-13b4369e-bf94-4432-ba58-4939af4bc5b7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0505767 Nov 24 16:25:10.427153 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65fe9455-4839-45d6-b348-201235ea81f7 req-2af70d6a-2f1f-4fb5-8298-00fd4974d38f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492990 Nov 24 16:25:10.559583 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c2fa2abf-897a-49c1-8e9e-6778642c2130 req-741396d0-6266-4f24-9e80-b9e9f3753a33 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0310957 Nov 24 16:25:10.633482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b9655e-4719-44e5-a13d-8854d30493f9 req-854239a3-1d49-4f1d-bdad-fe0d59a762ab tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:10.638205 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e4b9655e-4719-44e5-a13d-8854d30493f9 req-854239a3-1d49-4f1d-bdad-fe0d59a762ab tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0561218 Nov 24 16:25:10.688532 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e4b9655e-4719-44e5-a13d-8854d30493f9 req-d6739e42-8ae2-42ad-9fbe-000096f5c909 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475836 Nov 24 16:25:11.154751 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff22d6f-570c-414a-ba49-8719d9e964be req-ea8e9f5b-fba6-43c7-be10-84b5ffae599a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:11.156337 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-aff22d6f-570c-414a-ba49-8719d9e964be req-ea8e9f5b-fba6-43c7-be10-84b5ffae599a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0552354 Nov 24 16:25:11.301812 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-aff22d6f-570c-414a-ba49-8719d9e964be req-a65cb7b0-1606-47ba-9ed4-5a21a7cb7ada tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491159 Nov 24 16:25:11.545608 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fa574d-35f7-45ff-9c54-830566918e98 req-74290538-b55d-4181-8205-90c43cf4167c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:11.547096 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-61fa574d-35f7-45ff-9c54-830566918e98 req-74290538-b55d-4181-8205-90c43cf4167c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0497370 Nov 24 16:25:11.604698 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-61fa574d-35f7-45ff-9c54-830566918e98 req-c14dba14-512e-4cab-99ac-a1c0fcf0b0c2 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514536 Nov 24 16:25:11.689364 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-10890227-0941-4cc7-94c3-33434336294c req-7c7cdd72-9184-409f-ab31-255f963cb49b tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0272744 Nov 24 16:25:11.815372 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c672f671-53c0-436f-a26f-fd78a63d967d req-a8fc48c3-6c2e-4567-8020-e556743c29ac tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:11.816876 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c672f671-53c0-436f-a26f-fd78a63d967d req-a8fc48c3-6c2e-4567-8020-e556743c29ac tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0495315 Nov 24 16:25:11.868233 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c672f671-53c0-436f-a26f-fd78a63d967d req-8c111b03-7a2f-4e34-8636-149722cbc6b1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448408 Nov 24 16:25:12.336874 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d363cd-9cd9-4e00-92d8-b5c27d185b26 req-df9bdefa-6f6d-446c-9989-0a1c1e820f7c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:12.339381 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d9d363cd-9cd9-4e00-92d8-b5c27d185b26 req-df9bdefa-6f6d-446c-9989-0a1c1e820f7c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0525806 Nov 24 16:25:12.394110 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d9d363cd-9cd9-4e00-92d8-b5c27d185b26 req-f751a2bc-be77-4016-8809-8c2acdbd090a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497262 Nov 24 16:25:12.730834 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb90a73-7f69-4fad-8fd6-36a53a38fc0d req-d95d43ab-ee13-4957-be5d-e5eae84cc6ec tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:12.732382 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9fb90a73-7f69-4fad-8fd6-36a53a38fc0d req-d95d43ab-ee13-4957-be5d-e5eae84cc6ec tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0538971 Nov 24 16:25:12.783108 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9fb90a73-7f69-4fad-8fd6-36a53a38fc0d req-516c3b1a-d5c1-43fb-abf1-0e34cf3fe5f2 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448523 Nov 24 16:25:12.786831 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-eef63b28-c8aa-43b3-8b79-b6162cb09e51 req-cde23eac-7e79-4bd2-9af5-fd14ac3c7f14 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0260482 Nov 24 16:25:12.987732 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99368ab-50bd-4096-b4c6-450c58bfa0ce req-4eaace85-bc08-4d53-969c-07c22b31b61c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:12.989233 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e99368ab-50bd-4096-b4c6-450c58bfa0ce req-4eaace85-bc08-4d53-969c-07c22b31b61c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0497367 Nov 24 16:25:13.038795 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e99368ab-50bd-4096-b4c6-450c58bfa0ce req-37c3acf4-4629-426e-b7ad-d0f399231ecc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429800 Nov 24 16:25:13.512457 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7164f04-79ba-488f-a9a4-5ba079972c05 req-5b1b755f-a49a-4a68-bddc-b4bc29894db7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:13.513900 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7164f04-79ba-488f-a9a4-5ba079972c05 req-5b1b755f-a49a-4a68-bddc-b4bc29894db7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0509210 Nov 24 16:25:13.561560 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7164f04-79ba-488f-a9a4-5ba079972c05 req-63d5813c-cd8b-49f9-8cc3-5a6e287d1f65 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416720 Nov 24 16:25:13.883004 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3cfd8b1f-9ac6-434c-a431-e2e74b2a7e3f req-10eb1ae8-319b-43a1-967d-eb87bf4fae8c tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0257540 Nov 24 16:25:13.900446 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3393e5cb-8ead-497e-b97a-6ab9f5e3f9dd req-3f8f0ce5-0a89-413d-b9fd-c333a5408933 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:13.901928 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3393e5cb-8ead-497e-b97a-6ab9f5e3f9dd req-3f8f0ce5-0a89-413d-b9fd-c333a5408933 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0509844 Nov 24 16:25:13.947788 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3393e5cb-8ead-497e-b97a-6ab9f5e3f9dd req-256aa3e4-e6c5-4e1c-81c1-5941074e5fa8 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399253 Nov 24 16:25:14.156126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c9a7afd-1738-4993-bba8-ce5b6aa75714 req-af71757f-0035-464f-b4d6-cbbef2816c75 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:14.157593 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1c9a7afd-1738-4993-bba8-ce5b6aa75714 req-af71757f-0035-464f-b4d6-cbbef2816c75 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0479355 Nov 24 16:25:14.203467 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1c9a7afd-1738-4993-bba8-ce5b6aa75714 req-3d86fd4f-94c8-42cf-933f-0f78d993d486 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400851 Nov 24 16:25:14.678201 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc9acee-343f-4a8d-a830-bc0d48e3b9a1 req-dc40bc60-8ef1-4a9b-a74e-618a6d68ce88 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:14.679681 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-edc9acee-343f-4a8d-a830-bc0d48e3b9a1 req-dc40bc60-8ef1-4a9b-a74e-618a6d68ce88 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0475643 Nov 24 16:25:14.725594 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-edc9acee-343f-4a8d-a830-bc0d48e3b9a1 req-5a89c3c8-d536-45a0-a79d-a079824695b2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399890 Nov 24 16:25:14.981877 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-04dc12e4-611b-4bb2-93b1-4c988877c3fe req-314c6fea-7da7-4c76-ab02-c9cf210a52bf tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0311689 Nov 24 16:25:15.062212 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ebaa9f-c8fd-4cae-8598-3cb6751806d1 req-cc423927-0793-4663-97c2-a022e955c197 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:15.063676 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d7ebaa9f-c8fd-4cae-8598-3cb6751806d1 req-cc423927-0793-4663-97c2-a022e955c197 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0496268 Nov 24 16:25:15.109567 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d7ebaa9f-c8fd-4cae-8598-3cb6751806d1 req-80da4efb-4aa5-4fb0-9197-66010304fabc tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401282 Nov 24 16:25:15.328406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2215e9d9-da3b-4925-a199-a8edcc1a6abc req-51196f8c-af5d-45b9-990d-af10154e71ad tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:15.329915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2215e9d9-da3b-4925-a199-a8edcc1a6abc req-51196f8c-af5d-45b9-990d-af10154e71ad tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0552647 Nov 24 16:25:15.376052 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2215e9d9-da3b-4925-a199-a8edcc1a6abc req-172dc018-8a2d-4169-999f-b5bdc9f57d2e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401957 Nov 24 16:25:15.837371 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859e9023-7f9b-48aa-9c72-9097e9cb5c5c req-d662d226-2dd6-4a90-94b3-2b0280f88d9b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:15.838815 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-859e9023-7f9b-48aa-9c72-9097e9cb5c5c req-d662d226-2dd6-4a90-94b3-2b0280f88d9b tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0471902 Nov 24 16:25:15.883835 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-859e9023-7f9b-48aa-9c72-9097e9cb5c5c req-e85087ed-bc10-499b-857a-37c08f298ade tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392282 Nov 24 16:25:16.025674 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Request body: {'port': {'device_id': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:16.081947 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b25fd5b3-a554-4b41-b821-8e61ad3d03d8 req-057193d7-9ece-45a0-bce5-a707a929f330 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0305557 Nov 24 16:25:16.109456 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.227499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a08815f-2e31-4284-8ceb-e4859e3b77ed req-8035dc36-42d1-4699-a446-bd3dadf2e9f0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:16.229024 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1a08815f-2e31-4284-8ceb-e4859e3b77ed req-8035dc36-42d1-4699-a446-bd3dadf2e9f0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 932 time: 0.0488434 Nov 24 16:25:16.286702 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1a08815f-2e31-4284-8ceb-e4859e3b77ed req-4de0307c-b440-4199-9d8b-a073118fdc35 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515716 Nov 24 16:25:16.384696 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:25:16.392103 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.408631 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Transition to ACTIVE for port object 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:25:16.503717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed53d1a4-da1b-49af-8dfb-b66f2e3dd274 req-4665a446-3421-40eb-a5e6-bf66a9368ed2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:16.505109 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ed53d1a4-da1b-49af-8dfb-b66f2e3dd274 req-4665a446-3421-40eb-a5e6-bf66a9368ed2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0497105 Nov 24 16:25:16.517864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.602481 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ed53d1a4-da1b-49af-8dfb-b66f2e3dd274 req-d646fad3-e163-4cb8-a8b5-43423946564c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0907805 Nov 24 16:25:16.604372 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:16.682151 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Attempting to bind port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:25:16.682498 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Attempting to bind port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:25:16.682978 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Attempting to bind port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd on network 3244fb11-f411-4a53-b3cf-8285d8f01d99 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:25:16.687731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd on network 3244fb11-f411-4a53-b3cf-8285d8f01d99 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:25:16.692957 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Attempting to bind port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd on network 3244fb11-f411-4a53-b3cf-8285d8f01d99 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:25:16.694253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:25:16.694599 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Checking segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:25:16.695051 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Bound using segment: {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:25:16.695504 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Bound port: 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '95724655-bda4-4db3-b200-e095f21d8a6d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:25:16.695869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.772187 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:25:16.776191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:25:16.866048 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.901146 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:16.901859 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.903304 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] 10.222.0.84 "PUT /v2.0/ports/4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 1094 time: 0.8826993 Nov 24 16:25:16.905764 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:16.916005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbf13461-5931-4ff1-95d5-2b9da3109e23" -d '{"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:16.946715 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5963bdbb-a86b-4355-abbc-7217ea2449d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:16.955822 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a57ea14-6140-4d80-848e-8592705e8533 service neutron] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:16.964028 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2093709-6565-4a02-866d-65eb091d5dbe x-openstack-request-id: req-a2093709-6565-4a02-866d-65eb091d5dbe {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:16.964432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:16.964559 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a2093709-6565-4a02-866d-65eb091d5dbe {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:16.964955 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:25:17.028493 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6215f4-26fc-4710-86a7-6ec207f65c2b req-5ba9a58a-9233-4a4e-8ffa-9ade4f0709fa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.030409 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0f6215f4-26fc-4710-86a7-6ec207f65c2b req-5ba9a58a-9233-4a4e-8ffa-9ade4f0709fa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0553200 Nov 24 16:25:17.073308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-f2e8e140-3187-4fa1-8218-0f47fdea9303 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.075646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-f2e8e140-3187-4fa1-8218-0f47fdea9303 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1097 time: 0.0606148 Nov 24 16:25:17.083796 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0f6215f4-26fc-4710-86a7-6ec207f65c2b req-ba6e4e45-7129-4c3f-b35e-f72e4e79682a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461836 Nov 24 16:25:17.191449 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-edfaf11e-bc6c-4217-8d6b-5b9cb33bb0ef req-6ec9455f-84f2-4d2d-92f4-7a9982a589c5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0291250 Nov 24 16:25:17.212599 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-5f28e93d-7783-46aa-bd98-db9fc4d9b6ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.214957 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-5f28e93d-7783-46aa-bd98-db9fc4d9b6ef service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=4562b21a9bec4777b36baec6291778f5&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1309807 Nov 24 16:25:17.379792 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-00e4db79-9590-4281-8c05-158edfa59c6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.381186 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dbf13461-5931-4ff1-95d5-2b9da3109e23 req-00e4db79-9590-4281-8c05-158edfa59c6b service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1566541 Nov 24 16:25:17.403064 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ed0740-5de4-4fb9-941b-e770ee44748c req-2924fb51-85d8-4760-b8b7-d9857f861784 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.411195 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-d7dfb496-2e2d-4a46-98b9-a9d9b1c5f1c5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.412677 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-d7dfb496-2e2d-4a46-98b9-a9d9b1c5f1c5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "GET /v2.0/networks?id=796ec630-98f3-43e7-992a-da71da73d27a HTTP/1.1" status: 200 len: 814 time: 0.1290491 Nov 24 16:25:17.412870 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-33ed0740-5de4-4fb9-941b-e770ee44748c req-2924fb51-85d8-4760-b8b7-d9857f861784 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 944 time: 0.0583587 Nov 24 16:25:17.429347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Request body: {'port': {'device_id': '57388af0-a4b3-40be-8b61-b6b04436f788', 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a', 'admin_state_up': True, 'tenant_id': '321dd686a448414493dd3fa5f4429d91'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:17.457207 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-33ed0740-5de4-4fb9-941b-e770ee44748c req-4c483e38-8345-44c0-9172-13b99b1038de tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433035 Nov 24 16:25:17.534686 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-3933d81e-9678-4b2d-90fb-c406e983fff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.536177 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-3933d81e-9678-4b2d-90fb-c406e983fff0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1097 time: 0.1019871 Nov 24 16:25:17.586349 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-afc48f74-fac8-4275-98cc-8a00cc5f97c8 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 217 time: 0.0364068 Nov 24 16:25:17.903931 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-d0cae2e0-66f8-46d0-9d84-02099a2a5e00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.905341 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-d0cae2e0-66f8-46d0-9d84-02099a2a5e00 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.3068936 Nov 24 16:25:17.922203 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c49dd59-a989-470d-8c4c-292dc172f88d req-e6c35f56-7a59-4180-8363-945eae16fafe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:17.923627 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c49dd59-a989-470d-8c4c-292dc172f88d req-e6c35f56-7a59-4180-8363-945eae16fafe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0648596 Nov 24 16:25:17.965248 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Made reservation on behalf of 321dd686a448414493dd3fa5f4429d91 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:25:17.968683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:18.012476 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c49dd59-a989-470d-8c4c-292dc172f88d req-c528fa1d-acd7-4a00-849d-a2f94c55c35a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0812469 Nov 24 16:25:18.019114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-89b6254b-87ae-4c09-a388-62570e91b607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.020583 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-89b6254b-87ae-4c09-a388-62570e91b607 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1061182 Nov 24 16:25:18.199469 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-21e8c8ba-75ae-4182-8e31-5152e17871c1 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1462178 Nov 24 16:25:18.200742 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Allocated IP 172.20.0.11 (796ec630-98f3-43e7-992a-da71da73d27a/6aa9b822-d992-4b52-b747-b04d55bff714/ff67c722-0eb9-4e70-9f72-576a9db06955) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:25:18.207642 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8774e1bc-638a-4071-bcab-ebc47ae79fec req-e56ae8a6-fae9-4dba-a4dd-cc6a38d1c250 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.209263 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8774e1bc-638a-4071-bcab-ebc47ae79fec req-e56ae8a6-fae9-4dba-a4dd-cc6a38d1c250 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0525236 Nov 24 16:25:18.262574 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8774e1bc-638a-4071-bcab-ebc47ae79fec req-6d2145e1-ac93-424f-9422-018268f97740 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470769 Nov 24 16:25:18.339107 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-19f51783-0aaa-472c-a06b-45eb5721b773 req-1d755c71-7a16-4b0e-8c53-e29a7d011d32 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0638194 Nov 24 16:25:18.442502 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:18.465454 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a9715e4f-c028-4347-b7e1-6d363995d5f6 req-788ce1dc-ec65-4aa1-8a63-5c9e8481474c service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293385 Nov 24 16:25:18.572722 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f2eae6-d9fd-4b1e-aec0-e2dc3636a965 req-d423e55f-07dd-426d-b18c-96714338bd23 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.574186 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c2f2eae6-d9fd-4b1e-aec0-e2dc3636a965 req-d423e55f-07dd-426d-b18c-96714338bd23 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 944 time: 0.0491292 Nov 24 16:25:18.608894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:18.621317 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c2f2eae6-d9fd-4b1e-aec0-e2dc3636a965 req-a8358b62-3128-4f04-aa58-0ae74da0928a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409138 Nov 24 16:25:18.655728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Network 796ec630-98f3-43e7-992a-da71da73d27a is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:25:18.660769 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:25:18.664432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:25:18.691630 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Pushing event updated for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:18.726987 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.727610 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:18.795889 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-74a126f4-9bdc-47c6-a628-77302b30c57e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.797460 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-74a126f4-9bdc-47c6-a628-77302b30c57e service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 1097 time: 0.0836468 Nov 24 16:25:18.867341 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-d455e6e2-a06e-4528-92bf-87518063ac45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:18.868841 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-d455e6e2-a06e-4528-92bf-87518063ac45 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1097 time: 0.0462129 Nov 24 16:25:18.872175 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-237b4b88-048e-49ea-b3ae-d5557b78a452 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4467874 Nov 24 16:25:18.897547 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Request body: {'port': {'device_id': '57388af0-a4b3-40be-8b61-b6b04436f788', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:19.006265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:19.050212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-559a463d-4da4-4757-b57a-6c07902e4477 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.051742 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-559a463d-4da4-4757-b57a-6c07902e4477 service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.1657083 Nov 24 16:25:19.159480 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:25:19.225899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-efad41ae-6ab6-46a2-99ce-5b8cc02053c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:19.231481 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-67622907-6f94-440b-8257-30ad17095293 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 1000 time: 0.1623778 Nov 24 16:25:19.280148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041506b9-4221-4fa6-a98f-a47ed5ed4721 req-b5c5cd8b-28f5-4992-89be-6844a31104a9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.281519 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-041506b9-4221-4fa6-a98f-a47ed5ed4721 req-b5c5cd8b-28f5-4992-89be-6844a31104a9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.1760082 Nov 24 16:25:19.349291 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-3687676a-ca65-45f6-be8c-b9a26af79a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.349768 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-3687676a-ca65-45f6-be8c-b9a26af79a7d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.1087568 Nov 24 16:25:19.380767 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589653e8-cb47-4f8c-8e7b-9c842c1327ad req-07ce4e42-4daa-4785-9c75-a6d4c12e732e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.382324 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-589653e8-cb47-4f8c-8e7b-9c842c1327ad req-07ce4e42-4daa-4785-9c75-a6d4c12e732e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0512912 Nov 24 16:25:19.424425 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-041506b9-4221-4fa6-a98f-a47ed5ed4721 req-f224cc69-decd-428f-8f37-63457ea9322c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1149232 Nov 24 16:25:19.442715 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-589653e8-cb47-4f8c-8e7b-9c842c1327ad req-35b4ada4-ba49-46eb-890f-ef86d9547d38 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528336 Nov 24 16:25:19.462981 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-69032c8b-b4a9-4b35-bce3-e99a8a18d5d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.462981 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-69032c8b-b4a9-4b35-bce3-e99a8a18d5d2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0981791 Nov 24 16:25:19.526755 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ff67c722-0eb9-4e70-9f72-576a9db06955 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:25:19.561089 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:19.576994 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5a3bd55-11be-4241-9a4f-3ffcc2a64fae req-05df7673-660a-43b7-b7dd-099470757317 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.578602 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d5a3bd55-11be-4241-9a4f-3ffcc2a64fae req-05df7673-660a-43b7-b7dd-099470757317 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 932 time: 0.0538766 Nov 24 16:25:19.582938 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Transition to ACTIVE for port object ff67c722-0eb9-4e70-9f72-576a9db06955 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:25:19.598506 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-b3eb538e-63c6-4d59-a968-aaaf70f6ad8f service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1156642 Nov 24 16:25:19.626382 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d5a3bd55-11be-4241-9a4f-3ffcc2a64fae req-50a1fc1f-5bd4-4453-8ab5-0a87274d444d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412719 Nov 24 16:25:19.666801 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:19.759353 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Pushing event updated for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:19.769688 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f73080a-c028-405f-bf34-b69a6d84a026 req-52ee8d22-5dbb-4173-baa2-19a189216d0e service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1633644 Nov 24 16:25:19.832275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b23c48-ab19-4604-a6fd-a7057691e820 req-f84931c9-00ce-4b62-a9a4-0e08e0e45596 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:19.833747 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-67b23c48-ab19-4604-a6fd-a7057691e820 req-f84931c9-00ce-4b62-a9a4-0e08e0e45596 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 944 time: 0.1332603 Nov 24 16:25:19.871214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Attempting to bind port ff67c722-0eb9-4e70-9f72-576a9db06955 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:25:19.871563 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Attempting to bind port ff67c722-0eb9-4e70-9f72-576a9db06955 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:25:19.871897 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Attempting to bind port ff67c722-0eb9-4e70-9f72-576a9db06955 on network 796ec630-98f3-43e7-992a-da71da73d27a {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:25:19.883778 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Port ff67c722-0eb9-4e70-9f72-576a9db06955 on network 796ec630-98f3-43e7-992a-da71da73d27a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:25:19.883778 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Attempting to bind port ff67c722-0eb9-4e70-9f72-576a9db06955 on network 796ec630-98f3-43e7-992a-da71da73d27a {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:25:19.894809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 24, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:25:19.895200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Checking segment: {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:25:19.895586 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Bound using segment: {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:25:19.896034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Bound port: ff67c722-0eb9-4e70-9f72-576a9db06955, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:25:19.896391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:19.911065 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-67b23c48-ab19-4604-a6fd-a7057691e820 req-a7dc63bb-a4f5-4f17-8246-f9ea1618fecf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711434 Nov 24 16:25:19.965118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:25:19.968131 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=ff67c722-0eb9-4e70-9f72-576a9db06955,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:25:20.032046 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:20.070559 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.071212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:20.072585 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] 10.222.0.84 "PUT /v2.0/ports/ff67c722-0eb9-4e70-9f72-576a9db06955 HTTP/1.1" status: 200 len: 1094 time: 1.1786523 Nov 24 16:25:20.073026 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:20.075585 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4bce0a4-5d96-4f8b-bb08-bad4df883409" -d '{"events": [{"name": "network-changed", "server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:20.099798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43caa48-49f3-4d4f-8984-20151e912435 service neutron] Pushing event updated for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:20.119659 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c4ac99a-bc90-4e48-a643-b80edb22e9aa x-openstack-request-id: req-8c4ac99a-bc90-4e48-a643-b80edb22e9aa {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:20.120120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:20.120428 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-8c4ac99a-bc90-4e48-a643-b80edb22e9aa {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:20.120858 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955', 'status': 'completed', 'code': 200} Nov 24 16:25:20.192745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-93663716-8441-4201-9ade-5852d63eccb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.194849 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-93663716-8441-4201-9ade-5852d63eccb3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 1097 time: 0.0453811 Nov 24 16:25:20.321720 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-c3bb1f1c-2bb5-4481-b16f-86d333109de8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.323153 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-c3bb1f1c-2bb5-4481-b16f-86d333109de8 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=321dd686a448414493dd3fa5f4429d91&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1177340 Nov 24 16:25:20.362254 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:20.607435 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0301c4ea-aab1-4146-be81-fc94ad9d8cfd req-99c43304-9701-40b1-a822-1c6666e99efe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.609550 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0301c4ea-aab1-4146-be81-fc94ad9d8cfd req-99c43304-9701-40b1-a822-1c6666e99efe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0651386 Nov 24 16:25:20.611132 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26dedbb6-96ea-4a3f-97b8-27e89f9aef2c req-b32b40ba-3acf-42a1-a9dd-9a0290b60373 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.619052 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-26dedbb6-96ea-4a3f-97b8-27e89f9aef2c req-b32b40ba-3acf-42a1-a9dd-9a0290b60373 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0834801 Nov 24 16:25:20.680200 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0301c4ea-aab1-4146-be81-fc94ad9d8cfd req-ecadc05c-7fdc-4cf8-848f-c09ab196a5e2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0640564 Nov 24 16:25:20.712603 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-26dedbb6-96ea-4a3f-97b8-27e89f9aef2c req-4f2ac9ab-ea20-41f1-a3fa-ccc5fd4a1897 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917597 Nov 24 16:25:20.799670 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b408f953-c328-47b1-9c36-aa8f6c014bcf req-9ce8c23d-3ff7-4c03-8e42-0e075f449ab1 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:20.801656 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b408f953-c328-47b1-9c36-aa8f6c014bcf req-9ce8c23d-3ff7-4c03-8e42-0e075f449ab1 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0590048 Nov 24 16:25:20.866519 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b408f953-c328-47b1-9c36-aa8f6c014bcf req-afcf60e6-343c-4298-a0b6-1731b15e5e03 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530896 Nov 24 16:25:21.053728 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052bc6d7-7996-4303-a1c5-e48aba823c06 req-45dd9c3f-7ba6-4e7f-8c6f-9fbceb580741 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:21.060904 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-052bc6d7-7996-4303-a1c5-e48aba823c06 req-45dd9c3f-7ba6-4e7f-8c6f-9fbceb580741 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 944 time: 0.0543103 Nov 24 16:25:21.134319 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-052bc6d7-7996-4303-a1c5-e48aba823c06 req-8c295a39-26e4-47a7-ad24-04e27854b9db tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707879 Nov 24 16:25:21.174493 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:25:21.290999 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:21.314608 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'port_id': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'mac_address': 'fa:16:3e:7f:f1:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:25:21.354992 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:21.368826 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:25:21.392528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:21.603834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:21.668776 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:21.727965 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:21.828923 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5c8921-5a27-4a55-a6b5-1c5c6f75086e req-57dd6765-2f91-403b-a24a-148575ca8ea4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:21.830759 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a5c8921-5a27-4a55-a6b5-1c5c6f75086e req-57dd6765-2f91-403b-a24a-148575ca8ea4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0672028 Nov 24 16:25:21.837727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651ffe8a-e5a3-4579-bfa4-2ac8976ed759 req-77c689ba-5d6e-421b-83ab-462b80ad2aba tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:21.839551 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-651ffe8a-e5a3-4579-bfa4-2ac8976ed759 req-77c689ba-5d6e-421b-83ab-462b80ad2aba tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0684433 Nov 24 16:25:21.894148 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a5c8921-5a27-4a55-a6b5-1c5c6f75086e req-68aec045-2558-489e-b8bc-ad5c0dec620c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0560625 Nov 24 16:25:21.933816 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-651ffe8a-e5a3-4579-bfa4-2ac8976ed759 req-aeaa30d1-d065-447f-b4a9-795b619f951f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602915 Nov 24 16:25:21.939928 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:22.019862 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14804aee-320d-4df6-b9fb-5a8bdc7a55c2 req-831f97e5-5ad7-4bde-ba45-c6a42b7770ca tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:22.021350 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-14804aee-320d-4df6-b9fb-5a8bdc7a55c2 req-831f97e5-5ad7-4bde-ba45-c6a42b7770ca tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0590317 Nov 24 16:25:22.079553 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-14804aee-320d-4df6-b9fb-5a8bdc7a55c2 req-45013731-bc42-4eba-a9fd-fc218545e2a4 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514922 Nov 24 16:25:22.256864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef5d81-0baa-4d1d-818d-167e59faa72c req-66794cf8-27d8-4575-a339-84644f3f80c5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:22.258420 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-66ef5d81-0baa-4d1d-818d-167e59faa72c req-66794cf8-27d8-4575-a339-84644f3f80c5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 945 time: 0.0539658 Nov 24 16:25:22.307272 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-66ef5d81-0baa-4d1d-818d-167e59faa72c req-13445cda-7b44-4e18-ac29-4795f98d4a97 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429435 Nov 24 16:25:22.408960 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.037301 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a28fbd9-e65c-4075-a569-185ec39b2c72 req-c190b0df-0b44-4763-a5e7-fd155bdcec05 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:23.039071 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7a28fbd9-e65c-4075-a569-185ec39b2c72 req-c190b0df-0b44-4763-a5e7-fd155bdcec05 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0645854 Nov 24 16:25:23.054431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f176f4-28b1-46c1-b65a-562ef328f411 req-c1c5cf40-3359-4276-8aa7-b4c2975966d5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:23.057691 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-11f176f4-28b1-46c1-b65a-562ef328f411 req-c1c5cf40-3359-4276-8aa7-b4c2975966d5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0714400 Nov 24 16:25:23.106773 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7a28fbd9-e65c-4075-a569-185ec39b2c72 req-1ab27fb6-0da8-441b-ba4a-d7191fae4b61 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589645 Nov 24 16:25:23.114216 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-11f176f4-28b1-46c1-b65a-562ef328f411 req-a410bbdd-8405-4549-9ba3-f62bccf4648d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502698 Nov 24 16:25:23.181946 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:25:23.239685 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bc3845-ad8c-4551-93fb-63f1a5402579 req-8940cb81-86c4-4076-b9c9-7b8f6513a90a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:23.251589 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d9bc3845-ad8c-4551-93fb-63f1a5402579 req-8940cb81-86c4-4076-b9c9-7b8f6513a90a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0708447 Nov 24 16:25:23.303200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 50660) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:23.322061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:25:23.326670 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:25:23.327050 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.331056 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d9bc3845-ad8c-4551-93fb-63f1a5402579 req-e021ebd8-98fc-4672-a1a0-e8948ddb578b tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693438 Nov 24 16:25:23.424663 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.462041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d32ffa-53ff-49be-b598-7908f34b861f req-aa0ff2e1-4230-487a-aadc-d45635a89c29 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:23.463967 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33d32ffa-53ff-49be-b598-7908f34b861f req-aa0ff2e1-4230-487a-aadc-d45635a89c29 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 945 time: 0.0558512 Nov 24 16:25:23.476664 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:23.477728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:23.480328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f0cb442-2cb6-47ea-bd86-bceeb95158fa" -d '{"events": [{"server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "name": "network-vif-plugged", "status": "completed", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:23.483337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.528600 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a139d604-54a0-4d66-993f-3fec054a6fc0 x-openstack-request-id: req-a139d604-54a0-4d66-993f-3fec054a6fc0 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:23.528925 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "name": "network-vif-plugged", "status": "completed", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:23.529173 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a139d604-54a0-4d66-993f-3fec054a6fc0 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:23.529564 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'code': 200} Nov 24 16:25:23.575114 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.610815 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33d32ffa-53ff-49be-b598-7908f34b861f req-cf4e3316-11ed-43b6-a6c5-65fb6368a508 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242094 Nov 24 16:25:23.650898 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:23.658281 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.728500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.768045 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=be5a5853590042ffa8f987e3481e338d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4636650 Nov 24 16:25:23.768894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33a3f1b6-4a57-47da-b3e8-68bea5e13ca1,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:23.770898 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 50668) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:23.777176 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.777632 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.777870 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.778192 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.778785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.778987 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.779198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.779532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.779861 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.780188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.780509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.780830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c66bd2bb-1feb-415e-9e00-525d4b2c8c7e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:23.828718 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.850917 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.951815 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.955167 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:23.958208 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/33a3f1b6-4a57-47da-b3e8-68bea5e13ca1 HTTP/1.1" status: 204 len: 168 time: 0.1843872 Nov 24 16:25:23.965093 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12f8b8b-94a3-4d85-a78f-197154f8f2c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33a3f1b6-4a57-47da-b3e8-68bea5e13ca1,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:24.269484 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce74564d-002d-4b9f-ae8f-ca2e01d09bbe req-e38bc9b2-726b-4ce8-8d7e-cee90ba6eac6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:24.274028 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d319ef7-8d27-4409-b3b9-bb61bffe1cba req-aa06724e-819b-471c-849e-5aae5392bc3e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:24.276721 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ce74564d-002d-4b9f-ae8f-ca2e01d09bbe req-e38bc9b2-726b-4ce8-8d7e-cee90ba6eac6 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0642660 Nov 24 16:25:24.285650 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d319ef7-8d27-4409-b3b9-bb61bffe1cba req-aa06724e-819b-471c-849e-5aae5392bc3e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0936766 Nov 24 16:25:24.328311 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ce74564d-002d-4b9f-ae8f-ca2e01d09bbe req-98a22729-8e04-43d8-9438-9b75b8e74699 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507298 Nov 24 16:25:24.342884 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d319ef7-8d27-4409-b3b9-bb61bffe1cba req-a553d5ef-6980-4378-a880-f06b99bab980 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563807 Nov 24 16:25:24.473150 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27404ae6-5699-4e5c-a4ec-814186bae83e req-291b7842-b22b-4aea-876e-38a3b1763b08 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:24.481690 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27404ae6-5699-4e5c-a4ec-814186bae83e req-291b7842-b22b-4aea-876e-38a3b1763b08 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0608704 Nov 24 16:25:24.537588 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27404ae6-5699-4e5c-a4ec-814186bae83e req-5ea21de4-5c8c-454f-8274-6a6c80f05cc5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549841 Nov 24 16:25:24.734615 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e72d576-aae1-47cd-957c-4063a53c8245 req-51690d00-2670-435b-870e-7dece31add70 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:24.736327 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4e72d576-aae1-47cd-957c-4063a53c8245 req-51690d00-2670-435b-870e-7dece31add70 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0659804 Nov 24 16:25:24.789123 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4e72d576-aae1-47cd-957c-4063a53c8245 req-0a2b1ed5-4e30-4dbf-94b5-44ce00444624 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460286 Nov 24 16:25:25.511287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a41b8f2-5ee1-47ec-b8f5-6392ea8db2bc req-b5c6f0d4-4481-4c10-96a5-2d6eeb21b22e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:25.520410 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9a41b8f2-5ee1-47ec-b8f5-6392ea8db2bc req-b5c6f0d4-4481-4c10-96a5-2d6eeb21b22e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0887010 Nov 24 16:25:25.532378 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca6e4d6-f816-4132-9127-6f6787d2e3ac req-4084a423-4dd7-4425-bb3d-d5ee6965a6af tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:25.533857 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7ca6e4d6-f816-4132-9127-6f6787d2e3ac req-4084a423-4dd7-4425-bb3d-d5ee6965a6af tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0984735 Nov 24 16:25:25.570084 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9a41b8f2-5ee1-47ec-b8f5-6392ea8db2bc req-c48a0fc2-b1af-43fe-80bd-4e2f5da26680 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483365 Nov 24 16:25:25.611627 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7ca6e4d6-f816-4132-9127-6f6787d2e3ac req-469081e7-f34c-44e8-a774-cc94229f201c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701623 Nov 24 16:25:25.710749 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c6fca9-9faf-463a-b439-ee868bd67134 req-df75d68a-66bd-47ce-b6c6-8c81b207fbba tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:25.712876 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14c6fca9-9faf-463a-b439-ee868bd67134 req-df75d68a-66bd-47ce-b6c6-8c81b207fbba tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0603364 Nov 24 16:25:25.767800 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14c6fca9-9faf-463a-b439-ee868bd67134 req-f01896e5-29d8-419f-9697-734a38860f58 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480757 Nov 24 16:25:25.914973 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03445680-f325-4c28-9047-9ba79e678f2b req-4ce81f05-c890-4b2b-ba69-ce6d5aa334fc tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:25.916521 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-03445680-f325-4c28-9047-9ba79e678f2b req-4ce81f05-c890-4b2b-ba69-ce6d5aa334fc tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0528998 Nov 24 16:25:25.978062 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-03445680-f325-4c28-9047-9ba79e678f2b req-15068c97-f8e9-4d18-93bb-0b7e8e775d93 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554705 Nov 24 16:25:26.719232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad945d58-e41c-459e-a905-4b92bf12acff req-e453afb2-5676-414f-b6c9-7f0f2faf461a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:26.720915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ad945d58-e41c-459e-a905-4b92bf12acff req-e453afb2-5676-414f-b6c9-7f0f2faf461a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0613155 Nov 24 16:25:26.763237 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f705f7ba-6fb8-49b8-8988-1f8fea2ce169 req-9b5aa0f0-86a6-4b73-987c-6f08a16fd0d2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:26.764797 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f705f7ba-6fb8-49b8-8988-1f8fea2ce169 req-9b5aa0f0-86a6-4b73-987c-6f08a16fd0d2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0542595 Nov 24 16:25:26.779484 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ad945d58-e41c-459e-a905-4b92bf12acff req-9aecf015-c4df-4d5e-94e5-91b4d2421baa tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517712 Nov 24 16:25:26.857430 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f705f7ba-6fb8-49b8-8988-1f8fea2ce169 req-51287eb0-bded-4ddd-8d00-6ab327efad73 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856445 Nov 24 16:25:26.915632 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f223a169-028d-44a5-a374-e4f62da56e39 req-f8ca8413-df27-42ec-8691-b6e771201b30 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:26.917111 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f223a169-028d-44a5-a374-e4f62da56e39 req-f8ca8413-df27-42ec-8691-b6e771201b30 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0554459 Nov 24 16:25:26.965046 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f223a169-028d-44a5-a374-e4f62da56e39 req-ce4375c7-010f-4a4a-b5ef-7d5138795a9f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420699 Nov 24 16:25:27.117979 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71156409-3eb2-4ad6-9d54-7246836efa03 req-5d4fe01a-97fc-493c-b5e9-07ab73f4de27 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:27.122953 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-71156409-3eb2-4ad6-9d54-7246836efa03 req-5d4fe01a-97fc-493c-b5e9-07ab73f4de27 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0509820 Nov 24 16:25:27.189721 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-71156409-3eb2-4ad6-9d54-7246836efa03 req-130b0d87-5f6d-488a-a1f8-03d5f75fed56 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631967 Nov 24 16:25:27.981858 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6018fe-fe8e-40ec-a812-439479f76a12 req-3d4f7523-4555-4be6-a3ea-e220b337023c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:27.989138 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fa6018fe-fe8e-40ec-a812-439479f76a12 req-3d4f7523-4555-4be6-a3ea-e220b337023c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.1243267 Nov 24 16:25:28.001556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fa3af1-6ae0-4136-a347-a155f61aac28 req-13a475c5-4ff0-4fa3-9216-2da52f0e9a99 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:28.003987 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-51fa3af1-6ae0-4136-a347-a155f61aac28 req-13a475c5-4ff0-4fa3-9216-2da52f0e9a99 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0623305 Nov 24 16:25:28.072942 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-51fa3af1-6ae0-4136-a347-a155f61aac28 req-13839106-7c05-436d-8475-7f47823cbc7f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523777 Nov 24 16:25:28.082957 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fa6018fe-fe8e-40ec-a812-439479f76a12 req-83fbd449-9a8c-42a9-888e-7797e10d37aa tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0865161 Nov 24 16:25:28.186598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c5a78f4-e0d9-4773-9b8a-f1d0f1db0706 req-b233d706-f1bb-4733-9b60-ccee17d484e5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:28.189729 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9c5a78f4-e0d9-4773-9b8a-f1d0f1db0706 req-b233d706-f1bb-4733-9b60-ccee17d484e5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0555105 Nov 24 16:25:28.252176 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9c5a78f4-e0d9-4773-9b8a-f1d0f1db0706 req-162d58c2-e685-4487-82eb-babf7f29174a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539799 Nov 24 16:25:28.329203 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7dbc67-e290-4957-9abb-cf896567d6d0 req-020d655e-0b6d-49d4-8565-2c7927795a0b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:28.330662 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a7dbc67-e290-4957-9abb-cf896567d6d0 req-020d655e-0b6d-49d4-8565-2c7927795a0b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0620511 Nov 24 16:25:28.403134 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a7dbc67-e290-4957-9abb-cf896567d6d0 req-4e81339f-42db-4166-85c8-6db0c1019c17 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662818 Nov 24 16:25:28.654797 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:29.218740 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ed75fd-c5c1-47f6-9555-aa8c88f81b3c req-3fd85a6e-d3d9-4937-aca9-46f980681c0e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:29.221093 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-10ed75fd-c5c1-47f6-9555-aa8c88f81b3c req-3fd85a6e-d3d9-4937-aca9-46f980681c0e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0722301 Nov 24 16:25:29.231530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3926f6-a29f-4686-b30e-fc1548fc2157 req-822d4942-f1b6-4188-baf3-0dfd75168f53 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:29.233019 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a3926f6-a29f-4686-b30e-fc1548fc2157 req-822d4942-f1b6-4188-baf3-0dfd75168f53 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0842190 Nov 24 16:25:29.278787 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-10ed75fd-c5c1-47f6-9555-aa8c88f81b3c req-275b574e-68c9-4916-933e-47ec4838db0a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516853 Nov 24 16:25:29.297468 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0a3926f6-a29f-4686-b30e-fc1548fc2157 req-0d21337a-12f2-429f-b1d5-724cbb4f68e3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584633 Nov 24 16:25:29.405855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da380c2-f856-41a0-b011-114941c0cfee req-cee0213c-4fdc-422f-b0f4-15e4c674429d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:29.413184 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7da380c2-f856-41a0-b011-114941c0cfee req-cee0213c-4fdc-422f-b0f4-15e4c674429d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0640867 Nov 24 16:25:29.461829 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7da380c2-f856-41a0-b011-114941c0cfee req-87d9de04-d819-4492-9681-8b55a180e2f6 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477290 Nov 24 16:25:29.524118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d1ec66f-5009-4036-b3de-6e118fed961a req-03efc5af-acf5-41ca-9580-f7e50cc8a1d5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:29.527128 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7d1ec66f-5009-4036-b3de-6e118fed961a req-03efc5af-acf5-41ca-9580-f7e50cc8a1d5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0542161 Nov 24 16:25:29.581117 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7d1ec66f-5009-4036-b3de-6e118fed961a req-8c632882-e5e0-48e0-9ac7-0d28113f5072 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488958 Nov 24 16:25:30.422275 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6b2bf2-c3ea-4f1a-991d-6189fbbe4be5 req-31e016ef-e527-4aa1-ba33-af783a37fa77 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:30.423509 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cf6b2bf2-c3ea-4f1a-991d-6189fbbe4be5 req-31e016ef-e527-4aa1-ba33-af783a37fa77 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0598745 Nov 24 16:25:30.462974 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6396cf05-ea65-48b5-82a2-4af2b9ff42ab req-0d0b0725-c4bd-47b5-8425-13be200c2b29 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:30.469793 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6396cf05-ea65-48b5-82a2-4af2b9ff42ab req-0d0b0725-c4bd-47b5-8425-13be200c2b29 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0587311 Nov 24 16:25:30.510780 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cf6b2bf2-c3ea-4f1a-991d-6189fbbe4be5 req-21c7bf89-c7b6-4887-af11-d2df3ff67852 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789976 Nov 24 16:25:30.535086 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6396cf05-ea65-48b5-82a2-4af2b9ff42ab req-b921e26a-4d16-4afb-a65b-54d2bf6fcb2e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0640616 Nov 24 16:25:30.639228 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6b24b8-6649-4546-8846-61223f20df73 req-a34c0f32-13a0-467d-9ffe-9eac20368667 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:30.640972 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ea6b24b8-6649-4546-8846-61223f20df73 req-a34c0f32-13a0-467d-9ffe-9eac20368667 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0703294 Nov 24 16:25:30.694377 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ea6b24b8-6649-4546-8846-61223f20df73 req-9b33a824-a4e5-4654-a047-c918add1e013 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463123 Nov 24 16:25:30.707231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fe412e-a7b0-4599-adb0-8715cc6db116 req-825ba38c-0370-46ce-ac19-cd2b82814ff1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:30.709436 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-13fe412e-a7b0-4599-adb0-8715cc6db116 req-825ba38c-0370-46ce-ac19-cd2b82814ff1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0528405 Nov 24 16:25:30.766620 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-13fe412e-a7b0-4599-adb0-8715cc6db116 req-2161ce1b-2e33-4f3b-85eb-accc1d0a2b09 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474322 Nov 24 16:25:31.627647 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e1b15b-a2d8-4a7f-bf67-340d32e6887a req-6a585b38-3ea6-493d-8968-4312e16a66bb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:31.629124 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c2e1b15b-a2d8-4a7f-bf67-340d32e6887a req-6a585b38-3ea6-493d-8968-4312e16a66bb tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0488205 Nov 24 16:25:31.663301 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddea73d-bc4a-4f11-9620-da77f10a1a25 req-99e6fd81-9ae0-4c92-b1b3-70cb8f50da02 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:31.665465 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dddea73d-bc4a-4f11-9620-da77f10a1a25 req-99e6fd81-9ae0-4c92-b1b3-70cb8f50da02 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0550687 Nov 24 16:25:31.687020 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c2e1b15b-a2d8-4a7f-bf67-340d32e6887a req-d4bee4b9-692f-4c5f-abc2-f424b9b7c397 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517707 Nov 24 16:25:31.734518 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dddea73d-bc4a-4f11-9620-da77f10a1a25 req-6d1c8793-94eb-4733-809c-52e2163b58c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582676 Nov 24 16:25:31.866635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b248889b-a1ff-47fe-803f-d7315cb4d2de req-98a57b52-57bb-49c9-9e67-73ac3aab4727 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:31.868282 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b248889b-a1ff-47fe-803f-d7315cb4d2de req-98a57b52-57bb-49c9-9e67-73ac3aab4727 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0704119 Nov 24 16:25:31.924961 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b248889b-a1ff-47fe-803f-d7315cb4d2de req-13714b3d-5e91-477d-bbd8-72a4c5093384 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504768 Nov 24 16:25:32.134989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-a02e65e0-2d00-4257-9000-a267adf91efb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.136446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f4bce0a4-5d96-4f8b-bb08-bad4df883409 req-a02e65e0-2d00-4257-9000-a267adf91efb service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4264691 Nov 24 16:25:32.151916 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-1f565e98-0e19-4d95-ac28-57356be44cc0 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3654709 Nov 24 16:25:32.159147 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabc8ca5-7e04-41c0-abbd-6ec78144423c req-fff9bc81-36d9-4757-890b-0419d0e027c1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.160535 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fabc8ca5-7e04-41c0-abbd-6ec78144423c req-fff9bc81-36d9-4757-890b-0419d0e027c1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.1095037 Nov 24 16:25:32.167310 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-919b29ab-da03-4b64-8b95-b442656baaef req-95e39b67-1c23-441d-9f4b-942de4502a21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.168726 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-919b29ab-da03-4b64-8b95-b442656baaef req-95e39b67-1c23-441d-9f4b-942de4502a21 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1099 time: 0.1147792 Nov 24 16:25:32.276296 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fabc8ca5-7e04-41c0-abbd-6ec78144423c req-ee0bd7d0-717b-4431-9885-4279f6469632 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065209 Nov 24 16:25:32.308075 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-89e21f6c-e518-49a6-b8ca-79c785d90933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.309569 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-89e21f6c-e518-49a6-b8ca-79c785d90933 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 1099 time: 0.1199048 Nov 24 16:25:32.311161 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-454bb45a-2481-4eb1-afed-ec42235142d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.312492 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-454bb45a-2481-4eb1-afed-ec42235142d5 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 1097 time: 0.1069710 Nov 24 16:25:32.315765 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-919b29ab-da03-4b64-8b95-b442656baaef req-981ba05e-e828-4331-9e9f-834de9b692fd service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1207759 Nov 24 16:25:32.582385 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-073a89ec-3d41-4e19-956d-f9866a1392e2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ff67c722-0eb9-4e70-9f72-576a9db06955 HTTP/1.1" status: 200 len: 217 time: 0.0450270 Nov 24 16:25:32.677611 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-025a12f2-138d-4179-b91a-a38486b4761c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.679104 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-025a12f2-138d-4179-b91a-a38486b4761c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6aa9b822-d992-4b52-b747-b04d55bff714 HTTP/1.1" status: 200 len: 854 time: 0.0854404 Nov 24 16:25:32.707859 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-90a1c175-9ba9-4b6b-bb8e-dd8b0f892ea1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.709397 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-90a1c175-9ba9-4b6b-bb8e-dd8b0f892ea1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.1354582 Nov 24 16:25:32.725047 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-69d83cb8-562f-4fc3-a54a-c6b9d453036d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=796ec630-98f3-43e7-992a-da71da73d27a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0339401 Nov 24 16:25:32.765104 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-e0b1561e-20f0-4abd-9546-b3db4a1d52ea service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 200 len: 217 time: 0.0421643 Nov 24 16:25:32.803075 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e0c600-eb08-4278-ba91-ae149e3efbc8 req-e735fe0c-a248-4bf0-910a-6b61f584104c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.806176 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-20e0c600-eb08-4278-ba91-ae149e3efbc8 req-e735fe0c-a248-4bf0-910a-6b61f584104c tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0560398 Nov 24 16:25:32.852945 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-20e0c600-eb08-4278-ba91-ae149e3efbc8 req-f4b91b84-a97d-466a-8804-41a9aea1cf4a tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414727 Nov 24 16:25:32.895509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-041ce579-3b79-4c41-9a72-539c267ac500 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.896965 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-041ce579-3b79-4c41-9a72-539c267ac500 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.1205881 Nov 24 16:25:32.930649 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f05bd7-ef15-4ff9-9df1-54e5a2bef447 req-ebe5063d-ff2d-4bb4-b569-1017da55061e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:32.932153 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-85f05bd7-ef15-4ff9-9df1-54e5a2bef447 req-ebe5063d-ff2d-4bb4-b569-1017da55061e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.1171346 Nov 24 16:25:32.953181 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-b3c35ea1-f24f-4633-b345-2cf07d1d8414 service neutron] 10.222.0.84 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1961861 Nov 24 16:25:32.954889 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-faa154c3-ec48-4cae-b0af-5930a8fa8239 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0447404 Nov 24 16:25:33.036239 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe63d4-b10b-4456-bd1e-f2c6899cdedd req-4ed2b8c9-087b-479d-a0f1-e2dde9f7c78f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:33.037814 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2bfe63d4-b10b-4456-bd1e-f2c6899cdedd req-4ed2b8c9-087b-479d-a0f1-e2dde9f7c78f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0469031 Nov 24 16:25:33.099037 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2bfe63d4-b10b-4456-bd1e-f2c6899cdedd req-dc8b7c6c-1702-4d60-a78d-7cd2a889e42d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465920 Nov 24 16:25:33.119991 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-85f05bd7-ef15-4ff9-9df1-54e5a2bef447 req-2bd71ed2-d13e-4cce-a7cc-4f7d076f0ca3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1692271 Nov 24 16:25:33.159267 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-1b22bb6d-8e78-43ea-8b33-3574aa2857b7 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1891501 Nov 24 16:25:33.161276 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-37ee399b-6d13-4896-9ff9-04e7613d8ace req-02f81a8f-07b8-485f-82d1-3c9e94988735 service neutron] 10.222.0.84 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1936891 Nov 24 16:25:33.290754 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-025c6efe-429e-4bf7-a281-9ab78bacb386 req-5d0ee81e-151f-42e5-acf8-21e264753816 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1163595 Nov 24 16:25:33.293279 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10db8a3-052e-4cfa-a61e-87304fbeef14 req-e4228227-5aa0-44ac-9323-fdc7bb3ebb94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:33.294649 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f10db8a3-052e-4cfa-a61e-87304fbeef14 req-e4228227-5aa0-44ac-9323-fdc7bb3ebb94 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0608156 Nov 24 16:25:33.350169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f10db8a3-052e-4cfa-a61e-87304fbeef14 req-07eb0f2a-0d52-4178-893c-9618002b2b3f service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426161 Nov 24 16:25:33.391819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9549a5bb-83f4-4633-89b9-9399d312c4f9 req-0f07f008-7dec-4f78-8b3f-19d25c17d884 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:33.393243 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9549a5bb-83f4-4633-89b9-9399d312c4f9 req-0f07f008-7dec-4f78-8b3f-19d25c17d884 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0498757 Nov 24 16:25:33.439019 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9549a5bb-83f4-4633-89b9-9399d312c4f9 req-16d195ab-d909-4d39-bd2b-34bab77ef0b0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398152 Nov 24 16:25:33.970084 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdbe416b-1795-4b45-b473-79a4e1e529ed req-810d4c26-4e97-42f2-a2c0-815271b79c07 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:33.971604 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdbe416b-1795-4b45-b473-79a4e1e529ed req-810d4c26-4e97-42f2-a2c0-815271b79c07 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0494487 Nov 24 16:25:34.023302 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdbe416b-1795-4b45-b473-79a4e1e529ed req-a2c24901-62af-45cf-9e3a-7208d60ed282 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449567 Nov 24 16:25:34.218518 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190f4453-bd8f-4f9f-9c1a-e1f692babc7c req-1c2c5d59-c772-4d39-b0b4-92c9df8e2ee6 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:34.220189 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-190f4453-bd8f-4f9f-9c1a-e1f692babc7c req-1c2c5d59-c772-4d39-b0b4-92c9df8e2ee6 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0500324 Nov 24 16:25:34.258242 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaa56a3-8d82-4999-8112-71191b00d033 req-788e8848-8fa2-4507-85ce-8419d95eee0c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:34.259923 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efaa56a3-8d82-4999-8112-71191b00d033 req-788e8848-8fa2-4507-85ce-8419d95eee0c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0609591 Nov 24 16:25:34.279591 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-190f4453-bd8f-4f9f-9c1a-e1f692babc7c req-f04f1cfb-1b22-4c10-a888-ba1af4c7eb77 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452600 Nov 24 16:25:34.314765 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efaa56a3-8d82-4999-8112-71191b00d033 req-576dc051-bbcf-44b7-9511-e5e40125404a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459497 Nov 24 16:25:34.554465 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a47ca5-361c-4243-884f-25b4d238a3ac req-d474355e-2169-48fa-9563-2e78ed27b82b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:34.556585 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-54a47ca5-361c-4243-884f-25b4d238a3ac req-d474355e-2169-48fa-9563-2e78ed27b82b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0527596 Nov 24 16:25:34.604391 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-54a47ca5-361c-4243-884f-25b4d238a3ac req-9fa12482-104e-4944-be33-78bd72015b9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415428 Nov 24 16:25:34.716870 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb5005b1-ec65-401e-b5cc-d0baaa0fbf93 req-07e4e445-860f-4eb9-bc72-79c183518e3d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:34.718331 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fb5005b1-ec65-401e-b5cc-d0baaa0fbf93 req-07e4e445-860f-4eb9-bc72-79c183518e3d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0487247 Nov 24 16:25:34.765777 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fb5005b1-ec65-401e-b5cc-d0baaa0fbf93 req-59fbcd06-5a3f-41f9-b042-ca7b30fb80ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412905 Nov 24 16:25:35.101126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075110b7-c6ba-41d6-b7fa-8e198eb08880 req-38c5e702-a594-45fb-bf2f-2a031a8e6622 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.103635 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-075110b7-c6ba-41d6-b7fa-8e198eb08880 req-38c5e702-a594-45fb-bf2f-2a031a8e6622 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0594554 Nov 24 16:25:35.149730 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee95d427-01d6-4d0b-86fd-28a9e6c06cca req-2f42769d-08ac-4e21-b2dd-3088928b2fc2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.151651 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ee95d427-01d6-4d0b-86fd-28a9e6c06cca req-2f42769d-08ac-4e21-b2dd-3088928b2fc2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0582001 Nov 24 16:25:35.165139 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-075110b7-c6ba-41d6-b7fa-8e198eb08880 req-1b93d262-2e1e-4750-a059-42dab6b17eb1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538430 Nov 24 16:25:35.212202 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ee95d427-01d6-4d0b-86fd-28a9e6c06cca req-27fb45c2-b70d-47f4-a524-2571cd6839ee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535173 Nov 24 16:25:35.410812 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de46d737-455a-4c3f-8a89-2c059bcef7fc req-cbe38b29-99f7-476c-b400-79997ed2345a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.412373 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-de46d737-455a-4c3f-8a89-2c059bcef7fc req-cbe38b29-99f7-476c-b400-79997ed2345a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0561218 Nov 24 16:25:35.464258 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-de46d737-455a-4c3f-8a89-2c059bcef7fc req-1171203f-0b11-4ee0-a363-92898372de46 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448792 Nov 24 16:25:35.487099 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdeaebcf-96f5-459e-968e-9bcea5747c21 req-bedba7c9-3147-491d-b372-d122e1a45550 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.488750 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdeaebcf-96f5-459e-968e-9bcea5747c21 req-bedba7c9-3147-491d-b372-d122e1a45550 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0604725 Nov 24 16:25:35.542178 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdeaebcf-96f5-459e-968e-9bcea5747c21 req-d0fbedd1-6164-4592-ba90-104275e6de3c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470135 Nov 24 16:25:35.827995 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7b7b24-fb09-4e7d-a217-0f1121dd8837 req-0a5c19f9-cd9c-4c10-94dc-c559e60f0dca tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.827995 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f7b7b24-fb09-4e7d-a217-0f1121dd8837 req-0a5c19f9-cd9c-4c10-94dc-c559e60f0dca tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0626121 Nov 24 16:25:35.887217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-7b0d6fb1-78fe-4ab8-b1db-10eb78cd8183 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.888737 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-7b0d6fb1-78fe-4ab8-b1db-10eb78cd8183 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4ba85d6984964122836595e2e4cf8472&device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 1099 time: 0.0827565 Nov 24 16:25:35.907646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f7b7b24-fb09-4e7d-a217-0f1121dd8837 req-63604146-880d-4275-8c9b-4cd14b66b3f8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618975 Nov 24 16:25:35.986066 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-dae5d9c7-955c-415d-96d9-97c505c2deb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:35.987570 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-dae5d9c7-955c-415d-96d9-97c505c2deb6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 200 len: 920 time: 0.0904565 Nov 24 16:25:36.033837 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-f4f59659-172b-4f09-bc11-28ded3b7b26d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 200 len: 217 time: 0.0380433 Nov 24 16:25:36.085214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-7edc9905-7e7b-4313-8866-c02b7e08407b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:36.086602 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-7edc9905-7e7b-4313-8866-c02b7e08407b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 200 len: 859 time: 0.0448401 Nov 24 16:25:36.125439 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-6b70830f-749e-4b42-9501-57633b91503a service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=ca445c7d-56e8-4fcf-9c97-685da788b26d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256977 Nov 24 16:25:36.222263 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-6014d0d0-2f35-40ce-addc-75d54c69f639 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855286 Nov 24 16:25:36.315996 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c98aad1-e68e-40fb-a211-b238ea3f5001 req-218bbd70-cd0a-4910-ae92-77b3154ccca7 service neutron] 10.222.0.84 "GET /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838888 Nov 24 16:25:36.585015 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48184b58-7eff-47da-b1d3-1cd6e93200c1 req-0cd75ff7-87f6-43f1-bdd6-a02a31f6673f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:36.587339 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-48184b58-7eff-47da-b1d3-1cd6e93200c1 req-0cd75ff7-87f6-43f1-bdd6-a02a31f6673f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 944 time: 0.0532839 Nov 24 16:25:36.634653 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-48184b58-7eff-47da-b1d3-1cd6e93200c1 req-f65acd2b-7640-4906-afa8-6c83662343fb tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416012 Nov 24 16:25:36.670613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca6169a-f5ad-4bbf-a0be-a15a58ce4dba req-362f83b3-000a-4ae3-bab7-3d3d9a66775b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:36.672122 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1ca6169a-f5ad-4bbf-a0be-a15a58ce4dba req-362f83b3-000a-4ae3-bab7-3d3d9a66775b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0528927 Nov 24 16:25:36.723772 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1ca6169a-f5ad-4bbf-a0be-a15a58ce4dba req-8f44c969-0a8a-4723-a1ce-656021344a31 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456288 Nov 24 16:25:37.025158 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39efa426-5060-4d2d-85f7-6d6858e1d42d req-2d2634eb-84d5-43ad-9b2e-7b2b3bd77845 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:37.026667 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-39efa426-5060-4d2d-85f7-6d6858e1d42d req-2d2634eb-84d5-43ad-9b2e-7b2b3bd77845 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0495081 Nov 24 16:25:37.078870 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-39efa426-5060-4d2d-85f7-6d6858e1d42d req-2929cdc7-6700-4510-86ba-0ef0ed16a7ee tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461051 Nov 24 16:25:37.287606 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device ff67c722-0eb9-4e70-9f72-576a9db06955 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:25:37.388182 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=ff67c722-0eb9-4e70-9f72-576a9db06955,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:37.400647 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'ff67c722-0eb9-4e70-9f72-576a9db06955', 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a', 'port_id': 'ff67c722-0eb9-4e70-9f72-576a9db06955', 'mac_address': 'fa:16:3e:48:4e:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 856, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6aa9b822-d992-4b52-b747-b04d55bff714', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:25:37.438257 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:37.454522 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ff67c722-0eb9-4e70-9f72-576a9db06955 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:25:37.473601 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=ff67c722-0eb9-4e70-9f72-576a9db06955,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:37.568403 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:37.618296 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:37.626572 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.626976 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.630875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:37.747605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b507fb6-4e27-416d-94de-481c3d1114b2 req-87d67ba4-d599-4fe5-afc0-e882dcceecce tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:37.749054 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9b507fb6-4e27-416d-94de-481c3d1114b2 req-87d67ba4-d599-4fe5-afc0-e882dcceecce tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 945 time: 0.0471504 Nov 24 16:25:37.797163 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9b507fb6-4e27-416d-94de-481c3d1114b2 req-bfcc0497-33b5-42e2-ac56-a43af363443d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418437 Nov 24 16:25:37.903160 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c9b18e-885b-4b8b-865f-9b79ac928c28 req-32e9e690-8ec7-410c-b425-c58bef01fd04 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:37.904587 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f2c9b18e-885b-4b8b-865f-9b79ac928c28 req-32e9e690-8ec7-410c-b425-c58bef01fd04 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0502682 Nov 24 16:25:37.953305 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f2c9b18e-885b-4b8b-865f-9b79ac928c28 req-b85d92dd-e9d8-4e0a-b43b-0a55a6304e91 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426223 Nov 24 16:25:38.011742 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['ff67c722-0eb9-4e70-9f72-576a9db06955'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:38.196253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e1812c-de0b-438d-a5ba-2f1853a58241 req-73d8b3c0-f7a8-40d6-b6d0-a6b81b59b3f2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:38.197657 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-67e1812c-de0b-438d-a5ba-2f1853a58241 req-73d8b3c0-f7a8-40d6-b6d0-a6b81b59b3f2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0476530 Nov 24 16:25:38.245102 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-67e1812c-de0b-438d-a5ba-2f1853a58241 req-a47939cb-f680-4cd4-b153-9b721b6bd233 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408077 Nov 24 16:25:38.920613 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b128b105-aa26-463e-acd0-a6543b3ade4b req-832fdba3-6544-44b2-9a07-75c559ad8621 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:38.922117 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b128b105-aa26-463e-acd0-a6543b3ade4b req-832fdba3-6544-44b2-9a07-75c559ad8621 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 945 time: 0.0518725 Nov 24 16:25:38.969797 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b128b105-aa26-463e-acd0-a6543b3ade4b req-6f18ed89-fccc-4fcf-a2da-c74ecfd896d0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416281 Nov 24 16:25:39.076842 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9c3789-f8cf-47d6-b910-27aa0552e17e req-5ddf625a-03c5-4e5e-a0a8-236c92903dca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:39.078257 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9c3789-f8cf-47d6-b910-27aa0552e17e req-5ddf625a-03c5-4e5e-a0a8-236c92903dca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0495250 Nov 24 16:25:39.127287 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9c3789-f8cf-47d6-b910-27aa0552e17e req-69c3e4c1-c760-4dde-8b5d-c5ed32ebd8c5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427887 Nov 24 16:25:39.301802 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device ff67c722-0eb9-4e70-9f72-576a9db06955 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:25:39.366087 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f748820-c4ce-4233-a5ce-5918278c7db4 req-a4020bd3-8aac-4a80-8de2-ad2f25078ca1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:39.367635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f748820-c4ce-4233-a5ce-5918278c7db4 req-a4020bd3-8aac-4a80-8de2-ad2f25078ca1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0534973 Nov 24 16:25:39.413974 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port ff67c722-0eb9-4e70-9f72-576a9db06955 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:25:39.414209 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f748820-c4ce-4233-a5ce-5918278c7db4 req-12844e0f-53ca-4fdd-9aae-70b2746395e7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407827 Nov 24 16:25:39.417941 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port ff67c722-0eb9-4e70-9f72-576a9db06955 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:25:39.418313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:39.496540 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:39.520045 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:39.522255 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c693ebcf-8280-48f3-8891-5245a4e2f09f" -d '{"events": [{"server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "name": "network-vif-plugged", "status": "completed", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:39.537388 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=ff67c722-0eb9-4e70-9f72-576a9db06955,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:39.565875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50756880-c2da-465c-8f8b-48733b64efe8 x-openstack-request-id: req-50756880-c2da-465c-8f8b-48733b64efe8 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:39.566188 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "name": "network-vif-plugged", "status": "completed", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:39.566474 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-50756880-c2da-465c-8f8b-48733b64efe8 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:39.566866 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955', 'code': 200} Nov 24 16:25:39.624629 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:39.677083 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:39.908231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9153d290-3932-415a-93d1-c5508185db40 req-8344b4de-9326-40c1-8bb1-c18fe2010f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:39.909781 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9153d290-3932-415a-93d1-c5508185db40 req-8344b4de-9326-40c1-8bb1-c18fe2010f2a service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 1099 time: 0.0434999 Nov 24 16:25:39.964267 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9153d290-3932-415a-93d1-c5508185db40 req-16148bd0-d0d3-4720-ac30-0a3fa0cabe3e service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393767 Nov 24 16:25:40.085864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a31bd59-1844-4123-a68c-8d6798e269b7 req-b6203b91-0a0e-4e71-ae22-2066390b7b8c tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:40.087343 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a31bd59-1844-4123-a68c-8d6798e269b7 req-b6203b91-0a0e-4e71-ae22-2066390b7b8c tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0496278 Nov 24 16:25:40.135643 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a31bd59-1844-4123-a68c-8d6798e269b7 req-91516732-14f4-434d-a3cc-86dd8369b178 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424469 Nov 24 16:25:40.249117 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6abc0e-7430-4bc0-bf31-14623f5a5029 req-f6ac8645-5223-4787-8041-545306ee6a46 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:40.252502 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2e6abc0e-7430-4bc0-bf31-14623f5a5029 req-f6ac8645-5223-4787-8041-545306ee6a46 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0494781 Nov 24 16:25:40.303591 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2e6abc0e-7430-4bc0-bf31-14623f5a5029 req-a625560f-f86d-4cb5-b18b-f57dc9258a9f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469246 Nov 24 16:25:41.251956 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5f658c-7bc1-4688-9576-66ca02ed2100 req-96fa4d4a-667f-4ed6-8da3-5ebb37c06c4d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:41.253438 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6e5f658c-7bc1-4688-9576-66ca02ed2100 req-96fa4d4a-667f-4ed6-8da3-5ebb37c06c4d tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0490849 Nov 24 16:25:41.299238 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6e5f658c-7bc1-4688-9576-66ca02ed2100 req-84e576f6-d298-4a76-9a78-8fff8c4f46f1 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396631 Nov 24 16:25:41.321444 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:25:41.419800 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:41.428634 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92fa20bd-240b-4364-b53a-9e6a063d94b7 req-0cd3dd54-3744-40f0-8e20-6165750a414b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:41.431598 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-92fa20bd-240b-4364-b53a-9e6a063d94b7 req-0cd3dd54-3744-40f0-8e20-6165750a414b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 944 time: 0.0558136 Nov 24 16:25:41.436390 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'mac_address': 'fa:16:3e:4a:c5:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:25:41.479400 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:41.485225 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-92fa20bd-240b-4364-b53a-9e6a063d94b7 req-3a349c38-0b43-41e1-b209-cab5bdab9f81 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437174 Nov 24 16:25:41.493113 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:25:41.513145 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:41.580105 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:41.626645 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=9']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:41.969677 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['be934a2b-3080-4139-8519-7b3fdd48d05e'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:42.410321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a28ab12-4185-479a-89e0-9edb7ee33ecd req-9975e352-71e1-4330-80fe-b2da231c5ece tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:42.411824 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1a28ab12-4185-479a-89e0-9edb7ee33ecd req-9975e352-71e1-4330-80fe-b2da231c5ece tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0483365 Nov 24 16:25:42.457986 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1a28ab12-4185-479a-89e0-9edb7ee33ecd req-b9a5dbbe-f418-4b16-ab81-f5612a93aaad tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399392 Nov 24 16:25:42.608412 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23476c41-8896-4b51-bbc8-835a6a8b1147 req-1bb50be8-5c74-41c2-88b2-a7b7aef9808e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:42.609900 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-23476c41-8896-4b51-bbc8-835a6a8b1147 req-1bb50be8-5c74-41c2-88b2-a7b7aef9808e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 945 time: 0.0499573 Nov 24 16:25:42.656572 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-23476c41-8896-4b51-bbc8-835a6a8b1147 req-6f2d7c45-ab09-40a3-be04-0e554a01d6c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409346 Nov 24 16:25:43.331131 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:25:43.378655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port be934a2b-3080-4139-8519-7b3fdd48d05e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:25:43.379054 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:43.457152 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:43.480401 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:43.482581 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0b8fcba-4925-430b-a273-3919f56e9cd4" -d '{"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:43.496608 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:43.520933 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1093f497-252b-4cc5-863e-3cd7869dbf2b x-openstack-request-id: req-1093f497-252b-4cc5-863e-3cd7869dbf2b {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:43.521627 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-plugged", "status": "completed", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:43.521883 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-1093f497-252b-4cc5-863e-3cd7869dbf2b {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:43.522297 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'code': 200} Nov 24 16:25:43.608439 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:43.657075 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=10']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:43.777655 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3daa7c1-f694-4e53-9cb0-8ba60578f5d0 req-4c196177-de68-427a-9c28-0d86ed622f39 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:43.779158 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3daa7c1-f694-4e53-9cb0-8ba60578f5d0 req-4c196177-de68-427a-9c28-0d86ed622f39 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0479410 Nov 24 16:25:43.827980 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3daa7c1-f694-4e53-9cb0-8ba60578f5d0 req-9ed405ca-97cf-4074-b8e4-7eefa664194b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430439 Nov 24 16:25:44.360215 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fa764a-0ab7-47dd-8e3c-7a13594c6ae3 req-9d82c17f-2b48-43f2-8030-3abb276c1c11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:44.361648 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3fa764a-0ab7-47dd-8e3c-7a13594c6ae3 req-9d82c17f-2b48-43f2-8030-3abb276c1c11 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1100 time: 0.0391567 Nov 24 16:25:44.405483 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b3fa764a-0ab7-47dd-8e3c-7a13594c6ae3 req-9f0a39f8-8f16-4c75-ad44-ec95af0f5bb4 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0362341 Nov 24 16:25:44.950460 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e91b3f-875a-41e9-b976-bcd862573953 req-93532b08-1558-456e-a0e7-e8bbe4d8a6ea tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:44.952005 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e7e91b3f-875a-41e9-b976-bcd862573953 req-93532b08-1558-456e-a0e7-e8bbe4d8a6ea tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0509398 Nov 24 16:25:44.999830 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e7e91b3f-875a-41e9-b976-bcd862573953 req-839b94c8-4470-47ed-9acf-842bf67e2611 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417364 Nov 24 16:25:46.145775 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a873b307-17a5-4f54-8f51-2624c3295674 req-64e5184b-e03d-4ac1-ba88-3d1d5b33ca53 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:46.147440 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a873b307-17a5-4f54-8f51-2624c3295674 req-64e5184b-e03d-4ac1-ba88-3d1d5b33ca53 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0702522 Nov 24 16:25:46.202319 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a873b307-17a5-4f54-8f51-2624c3295674 req-a84dbd10-092f-45d8-9dca-21197f6a515e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476787 Nov 24 16:25:46.505739 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb4cb6f-359c-4edc-ba32-f44f0e52b949 req-6090a7b9-10db-4f56-a281-57c6c255919d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:46.507263 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-feb4cb6f-359c-4edc-ba32-f44f0e52b949 req-6090a7b9-10db-4f56-a281-57c6c255919d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0624912 Nov 24 16:25:46.554363 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-feb4cb6f-359c-4edc-ba32-f44f0e52b949 req-9b01b21a-c7ca-41dc-aec7-48466c6ef8ea tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411346 Nov 24 16:25:46.579882 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51090) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:46.798105 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95d4feec-8cad-45d6-a550-0171dc526677 tempest-TestMinimumBasicScenario-1576114443 tempest-TestMinimumBasicScenario-1576114443-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:46.799771 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-95d4feec-8cad-45d6-a550-0171dc526677 tempest-TestMinimumBasicScenario-1576114443 tempest-TestMinimumBasicScenario-1576114443-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1094 time: 0.2177558 Nov 24 16:25:46.802497 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51106) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:46.807581 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'port_id': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:46.905332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for floatingip, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:46.933630 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-be61793c-0f35-4733-9115-a04057c0673c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:47.006928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:47.121089 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Allocated IP 172.27.2.192 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/7ea07c0b-36db-4d9a-9fca-0df4174b22fd) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:25:47.231101 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:47.340924 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1278807f-1b87-41d4-afe7-bd5cbbdbfd66 req-dde18214-e0d1-4025-b29c-7ccb37a922c9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:47.342477 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1278807f-1b87-41d4-afe7-bd5cbbdbfd66 req-dde18214-e0d1-4025-b29c-7ccb37a922c9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0484395 Nov 24 16:25:47.384631 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:47.392749 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1278807f-1b87-41d4-afe7-bd5cbbdbfd66 req-7a72c945-c137-4895-b894-a4bf19609d52 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441749 Nov 24 16:25:47.429094 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:25:47.434079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:25:47.437595 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:25:47.462988 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'Port': ['ID=7ea07c0b-36db-4d9a-9fca-0df4174b22fd,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:47.916143 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.314181 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.490769 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.518291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d9e1d1-decb-40ce-91c3-9a1d297e1030 req-52c993c8-4146-40f7-9bbd-9de3fa5258f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:48.520050 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f0d9e1d1-decb-40ce-91c3-9a1d297e1030 req-52c993c8-4146-40f7-9bbd-9de3fa5258f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0525179 Nov 24 16:25:48.568509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.651253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'Port': ['ID=7ea07c0b-36db-4d9a-9fca-0df4174b22fd,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:48.667204 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:48.776656 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f0d9e1d1-decb-40ce-91c3-9a1d297e1030 req-c587a9d6-3012-4853-9522-a60fc4a58fa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2506692 Nov 24 16:25:48.778553 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Floating IP e3fe0d79-7872-4fc7-bddc-ad794246e0c7 associated. External IP: 172.27.2.192, port: 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd. Nov 24 16:25:48.989574 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Router 05159c2b-a330-441e-ab5d-008b311018b8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:25:49.097204 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:25:49.109493 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Sync routers for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:25:49.120618 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:25:49.121269 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:25:49.187219 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.214274 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7bd169c0-904c-4b55-8a74-e77c1d4dabbf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4106710 Nov 24 16:25:49.214888 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:49.217057 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51156) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:49.221429 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1307067382', 'description': 'tempest-secgroup-smoke-1307067382 description', 'project_id': '4562b21a9bec4777b36baec6291778f5'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:49.224022 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38630dbb-a445-4d88-908d-d19d1429e075" -d '{"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:49.249466 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:25:49.251201 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3ca8565d-5e27-47c1-91d2-0f094a288b4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.282629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b312cd63-31d4-4b99-8d43-9ab0787b7ac4 x-openstack-request-id: req-b312cd63-31d4-4b99-8d43-9ab0787b7ac4 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:49.282948 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:49.283212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b312cd63-31d4-4b99-8d43-9ab0787b7ac4 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:49.283623 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:25:49.345279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.364135 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38630dbb-a445-4d88-908d-d19d1429e075 req-4d5dd60b-9707-484d-b686-f4b5ed7bc087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:49.365704 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-4d5dd60b-9707-484d-b686-f4b5ed7bc087 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1099 time: 0.0522070 Nov 24 16:25:49.427657 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.488840 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38630dbb-a445-4d88-908d-d19d1429e075 req-0e5edff4-bbb2-4582-bd9a-c09fc8d537dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:49.490353 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-0e5edff4-bbb2-4582-bd9a-c09fc8d537dd service neutron] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 916 time: 0.1044970 Nov 24 16:25:49.501755 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e3fe0d79-7872-4fc7-bddc-ad794246e0c7', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'floating_ip_address': '172.27.2.192', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'port_id': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'mac_address': 'fa:16:3e:7f:f1:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:25:47Z', 'updated_at': '2021-11-24T16:25:47Z', 'revision_number': 0, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:25:49.528265 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.531088 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Checking router: 05159c2b-a330-441e-ab5d-008b311018b8 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:25:49.540498 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:25:49.541705 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:25:49.560161 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroup': ['ID=81430262-9c5c-4867-b9c2-ff9fd333721e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:49.567659 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.568142 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.568628 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.569074 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.569537 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.569982 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.570457 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.571619 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.571961 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.572330 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.574482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.574482 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:25:49.577986 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-19c11bdd-fb3e-43c2-9871-474be83d31b6 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 1000 time: 0.0699241 Nov 24 16:25:49.627499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.629864 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-f4ba19a7-ce4e-4683-879c-f075e112e698 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4117823 Nov 24 16:25:49.632672 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51164) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:49.638629 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:49.641095 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38630dbb-a445-4d88-908d-d19d1429e075 req-0a0d3586-37cf-426d-bed9-5677d6ba9bbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:49.643272 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-0a0d3586-37cf-426d-bed9-5677d6ba9bbc service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.0570569 Nov 24 16:25:49.667429 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:25:49.703114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38630dbb-a445-4d88-908d-d19d1429e075 req-8f4e4475-44dd-41e1-aca1-de90af5d3f8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:49.704652 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-8f4e4475-44dd-41e1-aca1-de90af5d3f8d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0536275 Nov 24 16:25:49.734496 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.811159 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.820500 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-822aae45-5986-4779-8945-2db7cb3f1df4 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1030517 Nov 24 16:25:49.870269 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.889885 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fe619f01-46cd-4394-b737-20a7128f6602,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:49.939876 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e3fe0d79-7872-4fc7-bddc-ad794246e0c7', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'floating_ip_address': '172.27.2.192', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'port_id': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'mac_address': 'fa:16:3e:7f:f1:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:25:47Z', 'updated_at': '2021-11-24T16:25:47Z', 'revision_number': 0, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:25:49.947298 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-38630dbb-a445-4d88-908d-d19d1429e075 req-bc5e3d97-6928-4b90-9ed7-d2fefb5b4d90 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1086869 Nov 24 16:25:49.966113 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:49.967360 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-171a52b1-3abc-44d9-939d-42bf4842cf2a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3336790 Nov 24 16:25:49.972971 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51178) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:49.973523 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-928a620e-a902-491e-8dba-2b21d698b6fa None None] The sync data for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi is: [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e3fe0d79-7872-4fc7-bddc-ad794246e0c7', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'floating_ip_address': '172.27.2.192', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'port_id': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 425, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'mac_address': 'fa:16:3e:7f:f1:37', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:25:47Z', 'updated_at': '2021-11-24T16:25:47Z', 'revision_number': 0, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:25:49.977553 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:50.076068 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.138130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.191133 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2a48139-aac3-417b-bef1-873470c875f6 None None] New status for floating IP e3fe0d79-7872-4fc7-bddc-ad794246e0c7: ACTIVE {{(pid=103143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:25:50.219201 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.239080 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58af916f-d88b-433f-bfb3-891338516fc9,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:50.294639 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.295918 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-5da910f8-c554-4541-96c8-75d4391c9425 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3219011 Nov 24 16:25:50.298554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51180) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:50.302995 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:50.373215 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.432189 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.476723 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.495292 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.515813 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e98f5c86-3b16-4e8c-96ec-cffbbbc1f9b7,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:50.615041 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.616276 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7eb2003f-9ccf-4e0b-b80c-9d69e841bf9d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3167429 Nov 24 16:25:50.619107 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51184) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:50.623479 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:50.744486 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.805748 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.894004 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.914892 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ccb9599d-8a61-4fb7-8957-7e2aa945bf0a,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:50.969405 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:50.970677 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a4f479a8-2ab1-4a37-aef2-f6af30bc5568 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3505726 Nov 24 16:25:50.973387 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51190) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:50.977883 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:51.087456 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Project 4562b21a9bec4777b36baec6291778f5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:25:51.092823 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.156078 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.236643 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.254198 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43f72291-f67c-41e6-80d5-83d088318737,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:51.324697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.326000 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c6ace7ab-ed29-4b21-99f9-97730b9aa9c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3514347 Nov 24 16:25:51.329274 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51196) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:25:51.333477 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'security_group_rule': {'security_group_id': '81430262-9c5c-4867-b9c2-ff9fd333721e', 'project_id': '4562b21a9bec4777b36baec6291778f5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:51.463706 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b14af752-03c0-4164-a7e5-f3a5cbf6d19c req-507043ce-2a70-4204-9a57-04b897c587e4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:51.465183 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b14af752-03c0-4164-a7e5-f3a5cbf6d19c req-507043ce-2a70-4204-9a57-04b897c587e4 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0490389 Nov 24 16:25:51.471239 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Project 4562b21a9bec4777b36baec6291778f5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:25:51.476377 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.528510 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b14af752-03c0-4164-a7e5-f3a5cbf6d19c req-4ea97fb9-0dd4-4256-b1b4-d2ddad6516c8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571971 Nov 24 16:25:51.563782 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.676404 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.696454 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54e929a4-e717-4357-9124-49d643e6afe9,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:51.744152 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.809102 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:51.810342 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-bf16a315-458e-4875-b9e7-585a44091a4b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4801309 Nov 24 16:25:51.909360 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-78f8a766-4ec1-4c02-8a28-10d23a050ab0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1307067382&fields=id&tenant_id=4562b21a9bec4777b36baec6291778f5 HTTP/1.1" status: 200 len: 267 time: 0.0544307 Nov 24 16:25:51.962781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-7fa3431c-bfeb-4542-8b42-2bd9146d8716 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:51.964291 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-7fa3431c-bfeb-4542-8b42-2bd9146d8716 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0492387 Nov 24 16:25:51.975536 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'port': {'security_groups': ['77b48aa8-a04d-471f-b619-b41c1aec3a12', '81430262-9c5c-4867-b9c2-ff9fd333721e']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:25:52.041629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.225830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:52.259354 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.315098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.358352 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:52.363141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.363141 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-65925d6a-b430-4b86-83c2-d8d0decd5c55 req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "PUT /v2.0/ports/4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 982 time: 0.3897178 Nov 24 16:25:52.363141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:52.363141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-283a7f9a-28f5-418c-a9b8-3421116d3127" -d '{"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:52.397684 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fe8a993-dc81-4133-8694-b3be69b4fc74 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=6']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:52.426400 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7b77467-c43f-4e55-8a14-04da393f95e9 x-openstack-request-id: req-d7b77467-c43f-4e55-8a14-04da393f95e9 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:52.426721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:52.427050 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-d7b77467-c43f-4e55-8a14-04da393f95e9 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:52.427729 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:25:52.442243 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.471049 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e726897-5c65-4401-82ae-f28b5b944be7 req-2608c891-1571-49fb-a0a3-f72e64718bba tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:52.472613 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1e726897-5c65-4401-82ae-f28b5b944be7 req-2608c891-1571-49fb-a0a3-f72e64718bba tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0537231 Nov 24 16:25:52.535295 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1e726897-5c65-4401-82ae-f28b5b944be7 req-02900cfd-6aae-4894-b5f9-8974c0b48a6b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0563822 Nov 24 16:25:52.586248 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-89647d15-b6f8-4044-af78-4d6f0ff372fc None None] Provisioning complete for port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:25:52.586870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-89647d15-b6f8-4044-af78-4d6f0ff372fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:52.659053 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3284f973-c951-4ac3-92dc-549009bcdca1 req-940b76a9-6491-4811-9e57-6c64d55f3cc8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:52.660703 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3284f973-c951-4ac3-92dc-549009bcdca1 req-940b76a9-6491-4811-9e57-6c64d55f3cc8 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0506098 Nov 24 16:25:52.709636 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3284f973-c951-4ac3-92dc-549009bcdca1 req-cf14be54-f6b8-4375-848c-bfdc5a9b987d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425870 Nov 24 16:25:53.828588 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb04ae1-858a-48bd-ac81-4226c6a97304 req-1ac37046-cf49-4b58-930b-2aa9e205e473 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:53.830069 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-eeb04ae1-858a-48bd-ac81-4226c6a97304 req-1ac37046-cf49-4b58-930b-2aa9e205e473 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0541906 Nov 24 16:25:53.877977 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-eeb04ae1-858a-48bd-ac81-4226c6a97304 req-1eb39194-8229-4fd1-ad34-d12777caa86f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412693 Nov 24 16:25:54.990638 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f476dab-110a-4436-9614-83e7790b4c95 req-954a8019-14f0-4f03-a5a4-d21082e9f3a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:54.992131 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3f476dab-110a-4436-9614-83e7790b4c95 req-954a8019-14f0-4f03-a5a4-d21082e9f3a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0474927 Nov 24 16:25:55.032300 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:55.047564 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3f476dab-110a-4436-9614-83e7790b4c95 req-30ed5d89-4b98-487b-9dab-cf6e8bc4c844 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491636 Nov 24 16:25:55.128720 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-ac783f78-8ffb-4c43-a751-2c50dde5bcdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:55.130244 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-ac783f78-8ffb-4c43-a751-2c50dde5bcdb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1138 time: 0.0465732 Nov 24 16:25:55.213688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:55.247076 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-afd2323d-c45a-455f-ac22-e7f7fb69a538 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:55.248478 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-afd2323d-c45a-455f-ac22-e7f7fb69a538 service neutron] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 916 time: 0.0854995 Nov 24 16:25:55.337004 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-db715451-10c5-47a6-ad18-361ff7770279 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 1002 time: 0.0708017 Nov 24 16:25:55.393613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-1fb83cc5-feb8-46c5-a622-412dee9cccc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:55.395170 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-1fb83cc5-feb8-46c5-a622-412dee9cccc5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.0440724 Nov 24 16:25:55.450300 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-560e750c-e302-4e9e-a5f6-5a1d6819622e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:55.451957 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-560e750c-e302-4e9e-a5f6-5a1d6819622e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0462985 Nov 24 16:25:55.567156 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-80293262-3950-4b63-8ba7-82875325cec0 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0991166 Nov 24 16:25:55.676915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-283a7f9a-28f5-418c-a9b8-3421116d3127 req-72f75b3f-7ebf-4e50-99e9-1fc0aa90a34a service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953584 Nov 24 16:25:56.158443 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:25:56.170373 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743f9ab2-9ed2-4907-bf58-2dcf8ea5e1e2 req-70d41cf8-7a90-47c5-bee3-207405993145 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:56.171906 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-743f9ab2-9ed2-4907-bf58-2dcf8ea5e1e2 req-70d41cf8-7a90-47c5-bee3-207405993145 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0501332 Nov 24 16:25:56.219250 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-743f9ab2-9ed2-4907-bf58-2dcf8ea5e1e2 req-1621c01c-3e1e-4689-8af6-7f6f1d3821fa tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412445 Nov 24 16:25:57.343609 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c9de1d-b45d-49cc-a5d9-50a1850c1a0c req-4beca9bd-aa2f-4c5e-83b0-459539f4f9b7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:57.345163 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-71c9de1d-b45d-49cc-a5d9-50a1850c1a0c req-4beca9bd-aa2f-4c5e-83b0-459539f4f9b7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0576806 Nov 24 16:25:57.393105 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-71c9de1d-b45d-49cc-a5d9-50a1850c1a0c req-f6315dfc-a4fa-41da-b403-ed8704f707b1 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415204 Nov 24 16:25:58.255329 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-2964c3a4-d9da-4d0c-a75e-a7b88ecbbb9d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:58.256808 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-2964c3a4-d9da-4d0c-a75e-a7b88ecbbb9d tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0490010 Nov 24 16:25:58.357022 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Deleting port 4d8f106b-a419-4d0a-974c-73ecb7118880 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:25:58.357677 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:58.445408 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] For port 4d8f106b-a419-4d0a-974c-73ecb7118880, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4d8f106b-a419-4d0a-974c-73ecb7118880,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:25:58.446334 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:58.459626 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Calling delete_port for 4d8f106b-a419-4d0a-974c-73ecb7118880 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:25:58.510050 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305f55f8-404a-44c7-b1c3-12f7eb6c5411 req-58e9ba54-caf2-4408-96e2-a0628ade4918 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:25:58.511554 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-305f55f8-404a-44c7-b1c3-12f7eb6c5411 req-58e9ba54-caf2-4408-96e2-a0628ade4918 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 946 time: 0.0485675 Nov 24 16:25:58.563005 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-305f55f8-404a-44c7-b1c3-12f7eb6c5411 req-04814155-dbcb-446d-b3e5-040e37788111 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442448 Nov 24 16:25:58.658422 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:58.664879 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:58.685188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Pushing event deleted for resources: {'Port': ['ID=4d8f106b-a419-4d0a-974c-73ecb7118880,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:25:58.689705 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['c2678985-882d-4aab-bdae-61a3cf1bd96a', '4d8f106b-a419-4d0a-974c-73ecb7118880'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:25:58.732122 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] No DVR routers for this DVR port 4d8f106b-a419-4d0a-974c-73ecb7118880 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:25:58.734631 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:25:58.738059 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-82904e2c-e45c-421b-89a6-8d90dd106fc4 req-c7a0f149-2a9d-489d-9db3-10b009eb19a2 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "DELETE /v2.0/ports/4d8f106b-a419-4d0a-974c-73ecb7118880 HTTP/1.1" status: 204 len: 173 time: 0.4684656 Nov 24 16:25:58.738504 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'name': 'network-vif-deleted', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:25:58.740772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70c2c922-e3e9-4a24-9201-18df5c4c239c" -d '{"events": [{"server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "name": "network-vif-deleted", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:25:58.776623 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:25:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f7408f5-b5ab-4bee-ac46-e8f1d81a7292 x-openstack-request-id: req-1f7408f5-b5ab-4bee-ac46-e8f1d81a7292 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:25:58.776940 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "be96317a-e685-455f-b235-c4f37627dd0d", "name": "network-vif-deleted", "tag": "4d8f106b-a419-4d0a-974c-73ecb7118880", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:25:58.777192 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-1f7408f5-b5ab-4bee-ac46-e8f1d81a7292 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:25:58.777593 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'be96317a-e685-455f-b235-c4f37627dd0d', 'name': 'network-vif-deleted', 'tag': '4d8f106b-a419-4d0a-974c-73ecb7118880', 'status': 'completed', 'code': 200} Nov 24 16:25:59.668239 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3162b1d7-e6ba-4896-9ca3-b1eb1c63c996 req-714cd76a-a96f-4b4a-89d5-c8ef7c81c748 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=be96317a-e685-455f-b235-c4f37627dd0d HTTP/1.1" status: 200 len: 210 time: 0.0260839 Nov 24 16:26:00.953179 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51318) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:01.054236 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4d8f106b-a419-4d0a-974c-73ecb7118880 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:01.062174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7784387a-eb0a-43c5-8ac5-fcf43dbab722 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.091636 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 4d8f106b-a419-4d0a-974c-73ecb7118880 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:01.092067 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4d8f106b-a419-4d0a-974c-73ecb7118880 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:01.148356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7784387a-eb0a-43c5-8ac5-fcf43dbab722 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.175523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629ba3b3-cf0d-4237-a48b-2e2f80a32b41 req-9740aa38-97cd-49cc-a4c7-1f9c57bf34cc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:01.177451 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-629ba3b3-cf0d-4237-a48b-2e2f80a32b41 req-9740aa38-97cd-49cc-a4c7-1f9c57bf34cc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0509627 Nov 24 16:26:01.225013 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7784387a-eb0a-43c5-8ac5-fcf43dbab722 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.231411 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-629ba3b3-cf0d-4237-a48b-2e2f80a32b41 req-3a748f24-285b-4ea8-86ca-dc367f7bb1dc tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473835 Nov 24 16:26:01.264846 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7784387a-eb0a-43c5-8ac5-fcf43dbab722 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=ecf7ef0d83c54f139dedd83d1cc57c9d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3104160 Nov 24 16:26:01.265791 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7784387a-eb0a-43c5-8ac5-fcf43dbab722 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3160fcd-e387-426a-9b7f-3ee42b1a656e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:01.267609 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51324) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:01.315225 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.336628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.453261 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.456040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:01.457210 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f3160fcd-e387-426a-9b7f-3ee42b1a656e HTTP/1.1" status: 204 len: 168 time: 0.1885061 Nov 24 16:26:01.464900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d13ed8-87fa-4be8-aead-076f8d2a319f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3160fcd-e387-426a-9b7f-3ee42b1a656e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:02.350073 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0751c3-6c3d-496a-84ce-10eea976364a req-f72e59ff-77b7-4b99-b83c-ae88551452ad tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:02.351579 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5e0751c3-6c3d-496a-84ce-10eea976364a req-f72e59ff-77b7-4b99-b83c-ae88551452ad tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0481625 Nov 24 16:26:02.401183 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5e0751c3-6c3d-496a-84ce-10eea976364a req-3aaccc2f-6912-47ee-9791-9306ae942074 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436509 Nov 24 16:26:02.488883 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51366) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:02.587309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1892691750-network', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:02.647281 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Made reservation on behalf of 34cb226439404c1cbbca2f36b3d8bec4 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:02.650089 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.661479 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.732817 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.790358 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.810486 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 893} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:26:02.825752 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b1cf0bc-88ab-436f-a81e-15e1e11538fa,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:02.829578 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.829931 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Added segment 7d803832-b892-4b8c-b302-2e5f6c49e7b3 of type vlan for network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 Nov 24 16:26:02.870519 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.950574 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:02.951473 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:02.952076 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.010853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] Pushing event updated for resources: {'Network': ['ID=12b56726-e7d3-442a-83b6-a1eb4c1c5936,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:03.020517 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:26:03.037811 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b307f7d7-d041-45c5-9293-89128654451a admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5478604 Nov 24 16:26:03.040834 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51370) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:03.045716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Request body: {'subnet': {'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1892691750-subnet', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:03.150768 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Made reservation on behalf of 34cb226439404c1cbbca2f36b3d8bec4 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:03.153154 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25215965'] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.350876 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-26164714', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25215951'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.404445 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Pushing event updated for resources: {'Subnet': ['ID=0d71b5b1-1ef3-47d2-bee8-078251e998a9,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:03.419611 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Checking segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:03.419972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Network hostable DHCP agents. Network: 12b56726-e7d3-442a-83b6-a1eb4c1c5936, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:26:03.499610 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:26:03.523085 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7cfdf85-a953-4056-88e6-71a01f172e30 req-5f70f828-546c-4a41-87ad-2c98dc58eb9f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:03.525220 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7cfdf85-a953-4056-88e6-71a01f172e30 req-5f70f828-546c-4a41-87ad-2c98dc58eb9f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0549557 Nov 24 16:26:03.574931 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f7cfdf85-a953-4056-88e6-71a01f172e30 req-6a9e5c69-de53-4362-afe5-e99a516029c7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437174 Nov 24 16:26:03.583304 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 12b56726-e7d3-442a-83b6-a1eb4c1c5936) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:03.587965 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:03.588621 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.599356 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d48be39-981e-4435-ad09-4fa62fb705c6 None None] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:03.679377 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bdd68ad2-3eec-4077-9a18-51888fc2c6ed admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6372716 Nov 24 16:26:03.682442 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51378) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:03.686693 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:03.741023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:26:03.741904 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.778428 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.779674 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.838434 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:03.873580 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Allocated IP 172.20.0.2 (12b56726-e7d3-442a-83b6-a1eb4c1c5936/0d71b5b1-1ef3-47d2-bee8-078251e998a9/b6fcc8a5-7b67-42ea-bec7-0807401b3d74) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:04.021917 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.038509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.109879 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.148545 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:04.155998 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:04.159468 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:04.168542 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Pushing event updated for resources: {'Port': ['ID=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:04.220889 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Attempting to bind port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:04.221271 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Attempting to bind port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:04.221642 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Attempting to bind port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 on network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:04.229144 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:04.229521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Checking segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:04.229925 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.230326 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Bound using segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:04.230794 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Bound port: b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:04.231200 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.292555 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] For port b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:04.295737 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] For port b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:04.333321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.352253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.355451 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.411963 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f18cc53-3ad2-4f56-bfdc-abfa40c88703 None None] Pushing event updated for resources: {'Port': ['ID=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:04.467831 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Allocated IP 172.27.2.106 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:04.584083 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.698501 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86405d99-f897-42f9-a151-2018e0465fba req-1d749c71-bdbd-4e2c-aaa2-323f27464c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:04.700295 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86405d99-f897-42f9-a151-2018e0465fba req-1d749c71-bdbd-4e2c-aaa2-323f27464c55 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0508826 Nov 24 16:26:04.705236 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:04.746336 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:04.749217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:04.749358 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86405d99-f897-42f9-a151-2018e0465fba req-fffa62df-b30b-453a-bdb8-c078b240eda7 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415065 Nov 24 16:26:04.751793 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:04.779741 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Pushing event updated for resources: {'Port': ['ID=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:05.060363 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.292003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6afde4f0-7297-45b9-9061-ddefb51be7aa None None] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:05.398688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] Provisioning complete for port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:05.399005 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.506355 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.539065 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.582138 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] For port b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:05.627702 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b6fcc8a5-7b67-42ea-bec7-0807401b3d74 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:05.668221 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.715388 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103142) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:26:05.724729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:05.727899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.727899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7316c1-cea9-4ab8-bbf7-63158d2ce434 None None] Pushing event updated for resources: {'Port': ['ID=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:05.863101 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:05.874352 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Sync routers for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:05.884580 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:05.885358 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:05.891839 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-d8e3717d-14c1-4b3a-b907-2cd91710cd48 None None] Provisioning complete for port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:05.892215 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d8e3717d-14c1-4b3a-b907-2cd91710cd48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.896819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ff1e13-63e4-49af-afc8-cb0b92c7ce15 req-92e72557-9cb9-4b1a-a0f6-dabfbcef1d90 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:05.896819 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e4ff1e13-63e4-49af-afc8-cb0b92c7ce15 req-92e72557-9cb9-4b1a-a0f6-dabfbcef1d90 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0699036 Nov 24 16:26:05.945696 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e4ff1e13-63e4-49af-afc8-cb0b92c7ce15 req-4318dcc9-5e73-4f39-be88-59f7890f522e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429890 Nov 24 16:26:05.960694 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:05.964110 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-61f369d0-9691-4013-8fa4-ba4eb7032ca1 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.2806482 Nov 24 16:26:05.973431 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51394) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:06.002398 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:06.194370 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:04Z', 'revision_number': 3, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:06.310962 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Checking router: ea0a4f3c-ff9f-4435-88e9-7e33de04f220 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:06.311316 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Updating router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:26:06.335936 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.404971 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.555438 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Allocated IP 172.20.0.1 (12b56726-e7d3-442a-83b6-a1eb4c1c5936/0d71b5b1-1ef3-47d2-bee8-078251e998a9/a31284af-dc72-471c-afcc-148c4da2b1b7) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:06.581776 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.668814 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.669232 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.723574 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Attempting to bind port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:06.723948 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Attempting to bind port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:06.724306 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Attempting to bind port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:06.727101 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Pushing event updated for resources: {'Port': ['ID=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:06.734473 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:06.734844 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:06.735278 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.735670 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:06.736128 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Bound port: d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:06.736531 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.739600 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.739984 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.740313 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.740648 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.740978 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.741308 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.741637 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.741963 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.742305 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.743184 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.743507 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.743830 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:06.792549 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] For port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:06.795599 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] For port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:06.802326 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.837243 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:06.840011 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:06.845328 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:06.881942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Pushing event updated for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:06.894000 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.895132 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:06.968074 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a6b990e-0b2c-4f95-bc3c-4dd643ca4929 None None] Pushing event updated for resources: {'Port': ['ID=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:06.973229 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:06.973229 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:07.024958 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9712a09d-eea7-4085-a07e-19b54a1f01f9 req-38c1fe9b-899d-410e-b754-c29946272566 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:07.033157 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9712a09d-eea7-4085-a07e-19b54a1f01f9 req-38c1fe9b-899d-410e-b754-c29946272566 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0641804 Nov 24 16:26:07.086957 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:07.103311 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9712a09d-eea7-4085-a07e-19b54a1f01f9 req-ca66db15-bf1a-4ed6-802f-cbe68e9acdf6 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0688720 Nov 24 16:26:07.156547 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.166175 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be1568b-27cd-419d-9b8d-22d6249e2ec7 req-cd4acd80-e58f-4e2a-bf3c-c6b972a2e34f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:07.167691 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6be1568b-27cd-419d-9b8d-22d6249e2ec7 req-cd4acd80-e58f-4e2a-bf3c-c6b972a2e34f tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.1096125 Nov 24 16:26:07.208771 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-0d0d6de5-f48a-46bf-ab39-b16a6e60866d None None] Provisioning complete for port a31284af-dc72-471c-afcc-148c4da2b1b7 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:07.209357 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0d0d6de5-f48a-46bf-ab39-b16a6e60866d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.253611 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-0d0d6de5-f48a-46bf-ab39-b16a6e60866d None None] Port a31284af-dc72-471c-afcc-148c4da2b1b7 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:07.258199 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6be1568b-27cd-419d-9b8d-22d6249e2ec7 req-f396ee71-94aa-402c-9449-dbe86583dbad tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831947 Nov 24 16:26:07.289704 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:04Z', 'revision_number': 3, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:07.316611 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cc3df81-06f7-4c1e-8680-4b790f68ea65 None None] The sync data for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi is: [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:04Z', 'revision_number': 3, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:07.392035 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.453685 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.524102 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.550472 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Pushing event updated for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:07.613646 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b6fcc8a5-7b67-42ea-bec7-0807401b3d74 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:07.668849 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:07.669311 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:07.752540 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:07.754026 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:07.886484 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:26:07.984317 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-f4af2418-56f4-4afc-8c5d-03e721bae920 None None] Provisioning complete for port a31284af-dc72-471c-afcc-148c4da2b1b7 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:07.984905 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-f4af2418-56f4-4afc-8c5d-03e721bae920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.014199 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:08.019769 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b88c0c23-83d0-4205-89aa-7059c698d842 admin admin] 10.222.0.82 "PUT /v2.0/routers/ea0a4f3c-ff9f-4435-88e9-7e33de04f220/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0445590 Nov 24 16:26:08.043060 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-f4af2418-56f4-4afc-8c5d-03e721bae920 None None] Port a31284af-dc72-471c-afcc-148c4da2b1b7 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:08.229635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d82fcf-aefc-4cdc-a2fb-857a406ff9de req-8d6d7f52-cc36-4088-9475-4beb3f9f343a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:08.229635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-78d82fcf-aefc-4cdc-a2fb-857a406ff9de req-8d6d7f52-cc36-4088-9475-4beb3f9f343a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0552008 Nov 24 16:26:08.275588 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-b5f9c595-6d34-4872-b4ab-4e65950a51e9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:08.277204 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-b5f9c595-6d34-4872-b4ab-4e65950a51e9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0605392 Nov 24 16:26:08.290544 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-78d82fcf-aefc-4cdc-a2fb-857a406ff9de req-c8952d45-faa3-495d-8f55-281cc0b8a4c5 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528493 Nov 24 16:26:08.415464 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67d0e03-9171-4ff5-86e9-bf16e0aacedc req-be38942b-7b1a-4fa7-b448-d6813a36370e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:08.416933 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c67d0e03-9171-4ff5-86e9-bf16e0aacedc req-be38942b-7b1a-4fa7-b448-d6813a36370e tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 946 time: 0.0634868 Nov 24 16:26:08.422569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Deleting port c2678985-882d-4aab-bdae-61a3cf1bd96a {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:26:08.422931 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.532775 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c67d0e03-9171-4ff5-86e9-bf16e0aacedc req-de61b729-016d-4d0c-a9cc-a1bb8c9acf10 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/security-groups?id=ed297a6f-8105-4b4b-8d75-e1b1548405a4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067884 Nov 24 16:26:08.551965 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] For port c2678985-882d-4aab-bdae-61a3cf1bd96a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=c2678985-882d-4aab-bdae-61a3cf1bd96a,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:08.552323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.565584 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Calling delete_port for c2678985-882d-4aab-bdae-61a3cf1bd96a owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:26:08.759956 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51436) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:08.764979 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-286564106-network', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:08.790812 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.803817 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['c2678985-882d-4aab-bdae-61a3cf1bd96a'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:26:08.821172 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Pushing event deleted for resources: {'Port': ['ID=c2678985-882d-4aab-bdae-61a3cf1bd96a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:08.853327 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Made reservation on behalf of b06295b6eebe467eb9949f985d105c3d for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:08.855953 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.864140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] No DVR routers for this DVR port c2678985-882d-4aab-bdae-61a3cf1bd96a on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:26:08.866743 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.867807 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:08.871148 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-31b20aa5-d588-4f9c-9a3c-edda6f25a6fe req-83a00d5c-3a57-4c26-abce-1d10138e0210 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.84 "DELETE /v2.0/ports/c2678985-882d-4aab-bdae-61a3cf1bd96a HTTP/1.1" status: 204 len: 173 time: 0.5843949 Nov 24 16:26:08.871592 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'name': 'network-vif-deleted', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:08.873817 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a4f6c64-f6e7-4ad1-b9ff-5fb0d2ba5662" -d '{"events": [{"server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "name": "network-vif-deleted", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:08.913749 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2789a023-02fb-42d5-9658-6d244a57683c x-openstack-request-id: req-2789a023-02fb-42d5-9658-6d244a57683c {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:08.914050 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77534ffc-f0eb-48a9-ad04-eb6b4d104021", "name": "network-vif-deleted", "tag": "c2678985-882d-4aab-bdae-61a3cf1bd96a", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:08.914353 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2789a023-02fb-42d5-9658-6d244a57683c {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:08.914753 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77534ffc-f0eb-48a9-ad04-eb6b4d104021', 'name': 'network-vif-deleted', 'tag': 'c2678985-882d-4aab-bdae-61a3cf1bd96a', 'status': 'completed', 'code': 200} Nov 24 16:26:08.951679 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.053359 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.079358 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 869} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:26:09.088446 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f09b7144-34ac-4a74-a0ee-cb72745b8884,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:09.095434 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.095785 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Added segment d35b9ee2-f009-4a81-970c-aa53418e6d7f of type vlan for network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 Nov 24 16:26:09.116703 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Sync routers for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:09.131251 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:09.132630 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:09.140479 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.230688 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.232000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:09.232631 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.295368 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] Pushing event updated for resources: {'Network': ['ID=6644be78-52ee-4cbb-add6-7a7dbcbc29c8,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:09.335572 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-cf8d6621-f3dc-4607-bfa8-24c34553a156 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5742040 Nov 24 16:26:09.338095 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51444) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:09.343283 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:26:09.343476 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Request body: {'subnet': {'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-286564106-subnet', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:09.420549 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612c7793-4fa1-4bda-abb7-9966d1e36e72 req-1a93150c-80c7-410e-b4b1-72f379e9fd94 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:09.421942 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-612c7793-4fa1-4bda-abb7-9966d1e36e72 req-1a93150c-80c7-410e-b4b1-72f379e9fd94 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0568945 Nov 24 16:26:09.428887 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:09.441891 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Made reservation on behalf of b06295b6eebe467eb9949f985d105c3d for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:09.444318 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.475816 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-612c7793-4fa1-4bda-abb7-9966d1e36e72 req-9be67277-d6e4-490f-b669-418782437f18 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476747 Nov 24 16:26:09.606279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:09.669023 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-26290af8-cf45-4a14-80c0-e51879c65603 req-5e0e2ac8-3bca-4653-90e3-d53a7c6e42a9 tempest-ServerRescueNegativeTestJSON-175887355 tempest-ServerRescueNegativeTestJSON-175887355-project] 10.222.0.82 "GET /v2.0/ports?device_id=77534ffc-f0eb-48a9-ad04-eb6b4d104021 HTTP/1.1" status: 200 len: 210 time: 0.0437195 Nov 24 16:26:09.705948 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:09.706329 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.755867 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 2, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:09.787527 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Checking router: ea0a4f3c-ff9f-4435-88e9-7e33de04f220 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:09.787875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Updating router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 port a31284af-dc72-471c-afcc-148c4da2b1b7 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:26:09.813537 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.834467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.853385 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:09.873120 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Pushing event updated for resources: {'Subnet': ['ID=129ce7ff-19a3-437b-a2b6-0854834cc7d6,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:09.882584 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Checking segment: {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:09.883558 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Network hostable DHCP agents. Network: 6644be78-52ee-4cbb-add6-7a7dbcbc29c8, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:26:09.894670 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:09.944772 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:26:09.954583 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.001744 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 6644be78-52ee-4cbb-add6-7a7dbcbc29c8) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:10.006162 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:10.007106 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.024650 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-791c5373-f930-4cda-bc99-5ede4915f71d None None] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:10.058969 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:10.090451 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ea4e7ec8-ff29-4d90-9050-c6aa6ad5c90b admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.7511983 Nov 24 16:26:10.092903 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51450) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:10.097301 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:10.178262 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.179359 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.239668 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.277507 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'fixed_ips': [{'subnet_id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:26:10.278354 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.284297 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.368887 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.460078 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be591131-ab5b-4e1c-bdcf-92dd5352ee93 None None] Pushing event updated for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:10.497412 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Allocated IP 172.20.0.2 (6644be78-52ee-4cbb-add6-7a7dbcbc29c8/129ce7ff-19a3-437b-a2b6-0854834cc7d6/9396411f-89ad-414a-abc7-f1d8d02f012f) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:10.548226 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Attempting to bind port a31284af-dc72-471c-afcc-148c4da2b1b7 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:10.548634 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Attempting to bind port a31284af-dc72-471c-afcc-148c4da2b1b7 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:10.549004 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Attempting to bind port a31284af-dc72-471c-afcc-148c4da2b1b7 on network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:10.563873 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:10.564254 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Checking segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:10.564660 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.565057 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Bound using segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:10.565546 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Bound port: a31284af-dc72-471c-afcc-148c4da2b1b7, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:10.565932 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.620041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d64f4b4-6e2a-44c9-b32c-94e9ce5a0db2 req-f8daee36-b8e1-4339-a8bb-ff94f91123f2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:10.625006 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9d64f4b4-6e2a-44c9-b32c-94e9ce5a0db2 req-f8daee36-b8e1-4339-a8bb-ff94f91123f2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0624976 Nov 24 16:26:10.641098 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.678506 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9d64f4b4-6e2a-44c9-b32c-94e9ce5a0db2 req-28177981-dd00-4d30-a2cb-afa946d3f67c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482347 Nov 24 16:26:10.730656 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] For port a31284af-dc72-471c-afcc-148c4da2b1b7, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:10.733640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51458) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:10.742586 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-dcb79ca0-e8f5-4d22-8dad-f6c03307d65b None None] Provisioning complete for port a31284af-dc72-471c-afcc-148c4da2b1b7 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:10.743052 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-dcb79ca0-e8f5-4d22-8dad-f6c03307d65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.772245 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] For port a31284af-dc72-471c-afcc-148c4da2b1b7, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a31284af-dc72-471c-afcc-148c4da2b1b7,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:10.799625 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.802168 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-dcb79ca0-e8f5-4d22-8dad-f6c03307d65b None None] Port a31284af-dc72-471c-afcc-148c4da2b1b7 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:10.865478 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.868598 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.927393 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.929364 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:10.935726 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:10.946723 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:10.947198 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:10.965578 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be591131-ab5b-4e1c-bdcf-92dd5352ee93 None None] Pushing event updated for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:10.965578 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:10.966047 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:11.076851 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device c2678985-882d-4aab-bdae-61a3cf1bd96a no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:11.093795 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Allocated IP 172.27.2.82 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/3a54d76d-c657-4cb9-935d-c5298f72182e) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:11.237175 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.240492 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.263405 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: c2678985-882d-4aab-bdae-61a3cf1bd96a {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:11.263405 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device c2678985-882d-4aab-bdae-61a3cf1bd96a not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:11.303303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Pushing event updated for resources: {'Port': ['ID=9396411f-89ad-414a-abc7-f1d8d02f012f,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:11.303303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Attempting to bind port 9396411f-89ad-414a-abc7-f1d8d02f012f on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:11.303303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Attempting to bind port 9396411f-89ad-414a-abc7-f1d8d02f012f by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:11.303708 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Attempting to bind port 9396411f-89ad-414a-abc7-f1d8d02f012f on network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:11.326044 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:11.326440 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Checking segment: {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:11.326853 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.327283 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Bound using segment: {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:11.327774 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Bound port: 9396411f-89ad-414a-abc7-f1d8d02f012f, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:11.328165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.348661 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] Provisioning complete for port a31284af-dc72-471c-afcc-148c4da2b1b7 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:11.349091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.362501 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.410090 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:11.413006 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:11.416652 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:11.421364 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:11.424453 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Pushing event updated for resources: {'Port': ['ID=3a54d76d-c657-4cb9-935d-c5298f72182e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:11.525355 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] For port 9396411f-89ad-414a-abc7-f1d8d02f012f, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:11.560505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Deleting port b73dc8ef-33b5-42c7-a949-ea14ee78b964 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:26:11.560819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.618374 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] For port 9396411f-89ad-414a-abc7-f1d8d02f012f, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9396411f-89ad-414a-abc7-f1d8d02f012f,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:11.629610 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:11.645852 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] For port b73dc8ef-33b5-42c7-a949-ea14ee78b964, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b73dc8ef-33b5-42c7-a949-ea14ee78b964,segment=NetworkSegment(2b6f6661-54d5-4f6c-8764-6630735e25e3),segment_id=2b6f6661-54d5-4f6c-8764-6630735e25e3)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:11.646430 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.660763 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.673580 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Calling delete_port for b73dc8ef-33b5-42c7-a949-ea14ee78b964 owned by network:router_interface {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:26:11.715438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.782290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] For port a31284af-dc72-471c-afcc-148c4da2b1b7, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a31284af-dc72-471c-afcc-148c4da2b1b7,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:11.790205 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.821834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da2b32ee-c01e-4136-ba72-d160812c7a13 None None] Pushing event updated for resources: {'Port': ['ID=9396411f-89ad-414a-abc7-f1d8d02f012f,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:11.826699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:11.827110 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.868371 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:11.894185 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1deb0b-8d2a-4580-9fa7-6743c01d1839 req-63e46823-442e-4083-9854-a5b2e02c1496 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:11.895878 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bc1deb0b-8d2a-4580-9fa7-6743c01d1839 req-63e46823-442e-4083-9854-a5b2e02c1496 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0940118 Nov 24 16:26:11.908291 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-eaff83fc-8463-420c-825b-24faed850238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:10Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:11.946362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaff83fc-8463-420c-825b-24faed850238 None None] The sync data for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi is: [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:10Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:11.968491 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf8d76c-8e44-4eb2-ac24-2552f7e85276 None None] Pushing event updated for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:12.050947 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bc1deb0b-8d2a-4580-9fa7-6743c01d1839 req-9845a87b-4943-4a50-aedd-15471f0f382f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1461053 Nov 24 16:26:12.053714 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:12.085758 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Pushing event deleted for resources: {'Port': ['ID=b73dc8ef-33b5-42c7-a949-ea14ee78b964,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:12.149308 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:12.329148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:12.420161 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Router 109af11a-ca44-4cd0-85ea-eeae78683a05 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:26:12.562766 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:12.575222 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Sync routers for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:12.589072 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:12.589608 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:12.621747 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:12.623233 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-dfce475f-3d72-49b5-abec-8f07575896a3 admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.5292630 Nov 24 16:26:12.626240 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51468) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:12.711638 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:12.870614 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:26:13.002076 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 3, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:13.033380 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:13.043678 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Checking router: 109af11a-ca44-4cd0-85ea-eeae78683a05 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:13.044254 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Updating router 109af11a-ca44-4cd0-85ea-eeae78683a05 port 3a54d76d-c657-4cb9-935d-c5298f72182e binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:26:13.044691 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Sync routers for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:13.049564 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3d2b8a63-5d16-4f0d-9fb4-ea3384adb93f admin admin] 10.222.0.82 "PUT /v2.0/routers/bdc4341e-4d45-47fe-80d6-6f412a2b97e4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3124270 Nov 24 16:26:13.050171 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51470) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:13.058015 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:13.059049 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:13.119216 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.204347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.231764 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:13.296089 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f06a7977-7569-4523-8d17-548d0e60ef6a None None] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:13.340979 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1493d26b-967f-4cb2-a408-5488106c73dd req-56be8de4-cbd1-4dc6-beaf-c7a7da2c9255 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:13.342664 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1493d26b-967f-4cb2-a408-5488106c73dd req-56be8de4-cbd1-4dc6-beaf-c7a7da2c9255 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1407099 Nov 24 16:26:13.374162 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.401430 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.431362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] Provisioning complete for port 9396411f-89ad-414a-abc7-f1d8d02f012f triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:13.434753 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.513025 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.533276 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1493d26b-967f-4cb2-a408-5488106c73dd req-4bbe5c30-0fac-4479-a4c0-ddfa2f581fcd tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1606839 Nov 24 16:26:13.545671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Deleting port 0f040003-e6a3-4ac1-bb78-cfe614ec4058 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:26:13.549392 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.590606 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.649449 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78b002a-b049-405e-9f7f-85b507e7ddd9 None None] Pushing event updated for resources: {'Port': ['ID=3a54d76d-c657-4cb9-935d-c5298f72182e,revision_number=2']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:13.660260 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Allocated IP 172.20.0.1 (6644be78-52ee-4cbb-add6-7a7dbcbc29c8/129ce7ff-19a3-437b-a2b6-0854834cc7d6/a8684d21-fddf-4b9c-b792-3202a29d136d) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:13.675828 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.677921 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Attempting to bind port 3a54d76d-c657-4cb9-935d-c5298f72182e on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:13.678556 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Attempting to bind port 3a54d76d-c657-4cb9-935d-c5298f72182e by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:13.679314 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Attempting to bind port 3a54d76d-c657-4cb9-935d-c5298f72182e on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:13.695612 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:13.696490 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:13.697281 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.697867 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:13.708887 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Bound port: 3a54d76d-c657-4cb9-935d-c5298f72182e, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:13.709550 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.735108 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] For port 9396411f-89ad-414a-abc7-f1d8d02f012f, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9396411f-89ad-414a-abc7-f1d8d02f012f,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:13.736376 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223'}], 'enable_snat': True}, 'gw_port_id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port': {'id': '0f040003-e6a3-4ac1-bb78-cfe614ec4058', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:92:1b:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.223', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:13.768458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] For port 0f040003-e6a3-4ac1-bb78-cfe614ec4058, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0f040003-e6a3-4ac1-bb78-cfe614ec4058,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:13.768458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.777139 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Calling delete_port for 0f040003-e6a3-4ac1-bb78-cfe614ec4058 owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:26:13.780049 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Checking router: bdc4341e-4d45-47fe-80d6-6f412a2b97e4 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:13.789120 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Routers {'bdc4341e-4d45-47fe-80d6-6f412a2b97e4'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:13.789744 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:13.797119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.818035 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] For port 3a54d76d-c657-4cb9-935d-c5298f72182e, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:13.825511 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] For port 3a54d76d-c657-4cb9-935d-c5298f72182e, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=3a54d76d-c657-4cb9-935d-c5298f72182e,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:13.844458 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.884603 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a31284af-dc72-471c-afcc-148c4da2b1b7 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:13.911307 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.939751 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:13.975871 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c63273d-f3ea-488b-887e-ce342f3edc35 None None] Pushing event updated for resources: {'Port': ['ID=9396411f-89ad-414a-abc7-f1d8d02f012f,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:13.979439 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] Set router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 gateway port host: None {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:13.992816 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Pushing event updated for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:14.006235 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:14.010872 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:14.012151 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:14.027158 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:14.028064 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:14.034946 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78b002a-b049-405e-9f7f-85b507e7ddd9 None None] Pushing event updated for resources: {'Port': ['ID=3a54d76d-c657-4cb9-935d-c5298f72182e,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:14.067203 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.143519 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.162281 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:14.177015 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:26:13Z', 'revision_number': 6, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:14.194493 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Pushing event deleted for resources: {'Port': ['ID=0f040003-e6a3-4ac1-bb78-cfe614ec4058,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:14.209958 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b52e209-491e-4447-b4ce-b2aee7734efb None None] The sync data for ids ['bdc4341e-4d45-47fe-80d6-6f412a2b97e4'] in dv-cinder-819007-2-iscsi is: [{'id': 'bdc4341e-4d45-47fe-80d6-6f412a2b97e4', 'name': 'tempest-ServerRescueNegativeTestJSON-1822871211-router', 'tenant_id': '4ba85d6984964122836595e2e4cf8472', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:18Z', 'updated_at': '2021-11-24T16:26:13Z', 'revision_number': 6, 'project_id': '4ba85d6984964122836595e2e4cf8472', 'gw_port_host': None}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:14.231241 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-1bfe41d5-d5d0-4d73-be58-651648df38f9 None None] Provisioning complete for port 9396411f-89ad-414a-abc7-f1d8d02f012f triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:14.231614 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1bfe41d5-d5d0-4d73-be58-651648df38f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.236043 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port a31284af-dc72-471c-afcc-148c4da2b1b7 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:14.236410 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.317058 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.327731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.410470 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 3, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:14.423677 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9396411f-89ad-414a-abc7-f1d8d02f012f up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:14.481986 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 9396411f-89ad-414a-abc7-f1d8d02f012f triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:14.483181 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.507032 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.511086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.539609 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.541331 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b4d4190-327e-4c3c-9e89-8acbbf1f0a1a None None] The sync data for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi is: [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 3, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:14.653882 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.662729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-391cced2-866d-4674-8c60-50c49e12f0ea None None] Provisioning complete for port a8684d21-fddf-4b9c-b792-3202a29d136d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:14.663145 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-391cced2-866d-4674-8c60-50c49e12f0ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.702414 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c954e223-7c87-42dd-a610-49365cbca005 req-ce4db39a-eab4-45f2-9dda-cf5e97b425cb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:14.706988 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-391cced2-866d-4674-8c60-50c49e12f0ea None None] Port a8684d21-fddf-4b9c-b792-3202a29d136d cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:14.712408 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c954e223-7c87-42dd-a610-49365cbca005 req-ce4db39a-eab4-45f2-9dda-cf5e97b425cb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0791442 Nov 24 16:26:14.727897 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.728512 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router bdc4341e-4d45-47fe-80d6-6f412a2b97e4 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:26:14.734169 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.737954 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f811a5a9-908f-4424-89ac-ee29346b3be4 admin admin] 10.222.0.82 "DELETE /v2.0/routers/bdc4341e-4d45-47fe-80d6-6f412a2b97e4 HTTP/1.1" status: 204 len: 168 time: 1.6867497 Nov 24 16:26:14.738454 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51480) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:14.752384 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Pushing event updated for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:14.772275 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:14.776872 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c954e223-7c87-42dd-a610-49365cbca005 req-6d3bac18-479e-4105-9d7e-29e111c55cdc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0636687 Nov 24 16:26:14.815855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Deleting subnet 11e98a82-ac30-426e-b0e8-ea5835b78bca {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:26:14.822004 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.119635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25189480'] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.184682 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:15.187412 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:15.193038 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.352804 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Router 109af11a-ca44-4cd0-85ea-eeae78683a05 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:26:15.417667 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25423536', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25555699'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.487670 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.494128 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51482) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:15.494766 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/11e98a82-ac30-426e-b0e8-ea5835b78bca HTTP/1.1" status: 204 len: 168 time: 0.7509985 Nov 24 16:26:15.497291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64eb37a-1268-4e1e-af8f-29a3bdc97e63 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=11e98a82-ac30-426e-b0e8-ea5835b78bca,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:15.523642 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:15.530016 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-cd16340f-77dc-46ae-9c49-16935ac86333 admin admin] 10.222.0.82 "PUT /v2.0/routers/109af11a-ca44-4cd0-85ea-eeae78683a05/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9027283 Nov 24 16:26:15.567543 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-3aa04020-f719-4319-bd2d-6fec9399c7ea None None] Provisioning complete for port a8684d21-fddf-4b9c-b792-3202a29d136d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:15.568016 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3aa04020-f719-4319-bd2d-6fec9399c7ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.651754 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-3aa04020-f719-4319-bd2d-6fec9399c7ea None None] Port a8684d21-fddf-4b9c-b792-3202a29d136d cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:15.680308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.774722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9396411f-89ad-414a-abc7-f1d8d02f012f up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:15.807772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.834700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca445c7d-56e8-4fcf-9c97-685da788b26d']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:15.847367 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b6f6661-54d5-4f6c-8764-6630735e25e3') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:15.847839 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b6f6661-54d5-4f6c-8764-6630735e25e3') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:15.863381 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.880542 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 9396411f-89ad-414a-abc7-f1d8d02f012f triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:15.880917 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.909417 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.919544 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Releasing vlan 888 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:26:15.920237 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:26:15.922510 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:26:15.990192 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fb1fb5-d868-439a-802f-a3919c57e5eb req-1071f4ed-4a5f-454d-b33b-d9763bc022b8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:15.991793 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-26fb1fb5-d868-439a-802f-a3919c57e5eb req-1071f4ed-4a5f-454d-b33b-d9763bc022b8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.1199021 Nov 24 16:26:15.993263 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 3a54d76d-c657-4cb9-935d-c5298f72182e up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:16.044145 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 3a54d76d-c657-4cb9-935d-c5298f72182e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:16.044596 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.050211 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-26fb1fb5-d868-439a-802f-a3919c57e5eb req-af6eba88-dc22-4a6c-8e62-52264c36c0c1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486517 Nov 24 16:26:16.083613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.091643 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.095149 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] 10.222.0.82 "DELETE /v2.0/networks/ca445c7d-56e8-4fcf-9c97-685da788b26d HTTP/1.1" status: 204 len: 168 time: 0.5988963 Nov 24 16:26:16.128851 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b1e578-7645-48b7-aac4-3e1871b20887 admin admin] Pushing event deleted for resources: {'Network': ['ID=ca445c7d-56e8-4fcf-9c97-685da788b26d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:16.180500 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.203187 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 3a54d76d-c657-4cb9-935d-c5298f72182e, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=3a54d76d-c657-4cb9-935d-c5298f72182e,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:16.267603 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.321187 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=3a54d76d-c657-4cb9-935d-c5298f72182e,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:16.335913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b73dc8ef-33b5-42c7-a949-ea14ee78b964 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:16.361166 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: b73dc8ef-33b5-42c7-a949-ea14ee78b964 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:16.361447 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b73dc8ef-33b5-42c7-a949-ea14ee78b964 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:16.361874 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0f040003-e6a3-4ac1-bb78-cfe614ec4058 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:16.388024 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 0f040003-e6a3-4ac1-bb78-cfe614ec4058 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:16.388377 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0f040003-e6a3-4ac1-bb78-cfe614ec4058 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:16.498281 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51504) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:16.502830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-646852380', 'description': 'tempest-secgroup-smoke-646852380 description', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:16.544561 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51506) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:16.588977 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bd9ceca8-e8ca-4d6e-86d4-86e18fd4103c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4ba85d6984964122836595e2e4cf8472&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0432706 Nov 24 16:26:16.591534 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51508) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:16.598856 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.678781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.715600 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.717602 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.777210 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.805417 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroup': ['ID=66a8af55-2ee6-4345-b62d-43183c79c046,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:16.840441 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Sync routers for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:16.850161 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:16.851023 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:16.852130 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.854708 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.858164 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed297a6f-8105-4b4b-8d75-e1b1548405a4 HTTP/1.1" status: 204 len: 168 time: 0.2634554 Nov 24 16:26:16.864499 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89924dd7-1c56-4ad5-9076-164a486cc38c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed297a6f-8105-4b4b-8d75-e1b1548405a4,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:16.891316 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.893974 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e16045e4-74f1-408c-84a8-cf52bca9ac61 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.3941195 Nov 24 16:26:16.896548 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51512) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:16.904469 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:16.956370 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-91fbae4c-b098-47b1-af5c-93368698a1e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:16.964529 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:16.985150 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.044955 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.095152 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.133528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0e3fd4d-3385-4bab-add1-7ff27197ebf9,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:17.187431 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:14Z', 'revision_number': 4, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a8684d21-fddf-4b9c-b792-3202a29d136d', 'name': '', 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'mac_address': 'fa:16:3e:e2:24:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:13Z', 'updated_at': '2021-11-24T16:26:14Z', 'revision_number': 2, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'subnets': [{'id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:17.192246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf4abeb-63e0-4ca8-80e8-ad99620f1d82 req-a618b0cf-4d35-4d24-8969-823ab1365899 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:17.194427 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3cf4abeb-63e0-4ca8-80e8-ad99620f1d82 req-a618b0cf-4d35-4d24-8969-823ab1365899 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0534751 Nov 24 16:26:17.198117 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.199547 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-bfee4f7a-532d-43fa-ab0a-021e182f1cb1 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3020380 Nov 24 16:26:17.202267 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51518) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:17.206724 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:17.219240 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Checking router: 109af11a-ca44-4cd0-85ea-eeae78683a05 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:17.219608 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Updating router 109af11a-ca44-4cd0-85ea-eeae78683a05 port a8684d21-fddf-4b9c-b792-3202a29d136d binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:26:17.245597 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.264889 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3cf4abeb-63e0-4ca8-80e8-ad99620f1d82 req-5035a5cc-724f-4e24-b675-217659cd4d1f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535815 Nov 24 16:26:17.326963 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.380500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.432827 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.457201 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1d2d0c1-134e-4b9e-855b-c1222373f73e,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:17.538212 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.545395 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.549329 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3350df9f-7217-48ce-b71b-75380c0a267b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3435745 Nov 24 16:26:17.549609 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51530) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:17.553904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:17.591325 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 3a54d76d-c657-4cb9-935d-c5298f72182e up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:17.639227 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 3a54d76d-c657-4cb9-935d-c5298f72182e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:17.639606 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.676194 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.747549 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176499ea-337e-4d25-afe3-32f78a9e94da None None] Pushing event updated for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:17.754190 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.793156 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Attempting to bind port a8684d21-fddf-4b9c-b792-3202a29d136d on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:17.794240 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Attempting to bind port a8684d21-fddf-4b9c-b792-3202a29d136d by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:17.795333 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Attempting to bind port a8684d21-fddf-4b9c-b792-3202a29d136d on network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:17.801937 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 25, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:17.802318 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Checking segment: {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:17.802719 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.803195 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Bound using segment: {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:17.803680 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Bound port: a8684d21-fddf-4b9c-b792-3202a29d136d, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd35b9ee2-f009-4a81-970c-aa53418e6d7f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:17.804132 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.839697 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.888358 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] For port a8684d21-fddf-4b9c-b792-3202a29d136d, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:17.892311 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] For port a8684d21-fddf-4b9c-b792-3202a29d136d, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a8684d21-fddf-4b9c-b792-3202a29d136d,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:17.900008 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.919008 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4c1c115c-6ce2-41af-a85a-3cd28c21ca92,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:17.945311 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.976045 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:17.980998 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51538) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:17.988973 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:17.991576 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f4d76be7-e00d-427e-b212-75f98f00d533 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4410093 Nov 24 16:26:17.997338 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] Provisioning complete for port a8684d21-fddf-4b9c-b792-3202a29d136d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:17.997806 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.015038 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176499ea-337e-4d25-afe3-32f78a9e94da None None] Pushing event updated for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=4']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.027227 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:18.027227 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:25:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:18.111005 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.117003 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51542) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:18.119789 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.161360 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] For port a8684d21-fddf-4b9c-b792-3202a29d136d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a8684d21-fddf-4b9c-b792-3202a29d136d,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:18.165801 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:18.189088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.239320 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-318228158-network', 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:18.247613 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.275753 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.294725 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f25fb340-664e-41e5-aab3-b9dfe2d65069,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.296640 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c93437-b718-4fb0-85ab-35e603ccf2e2 None None] Pushing event updated for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.339011 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:18.341353 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.350341 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.374007 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-6e7a1ae4-d639-4268-82d0-5f08da4a39c5 None None] Provisioning complete for port a8684d21-fddf-4b9c-b792-3202a29d136d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:18.374474 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6e7a1ae4-d639-4268-82d0-5f08da4a39c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.394573 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:14Z', 'revision_number': 4, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a8684d21-fddf-4b9c-b792-3202a29d136d', 'name': '', 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'mac_address': 'fa:16:3e:e2:24:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:13Z', 'updated_at': '2021-11-24T16:26:17Z', 'revision_number': 4, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'subnets': [{'id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:18.414135 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67699adb-0d5c-4577-8478-87d581715cd9 req-ad7debb4-cd65-4fb8-a507-428ba7aedee0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:18.422094 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-67699adb-0d5c-4577-8478-87d581715cd9 req-ad7debb4-cd65-4fb8-a507-428ba7aedee0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0631166 Nov 24 16:26:18.430292 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd21122b-aca2-45a0-bdab-7a432645e3bd None None] The sync data for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi is: [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:14Z', 'revision_number': 4, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a8684d21-fddf-4b9c-b792-3202a29d136d', 'name': '', 'network_id': '6644be78-52ee-4cbb-add6-7a7dbcbc29c8', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'mac_address': 'fa:16:3e:e2:24:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:13Z', 'updated_at': '2021-11-24T16:26:17Z', 'revision_number': 4, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'subnets': [{'id': '129ce7ff-19a3-437b-a2b6-0854834cc7d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:18.441474 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.442691 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b83850c6-800e-45bf-8420-33b9377d46ac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4601014 Nov 24 16:26:18.447408 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51550) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:18.456774 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:18.460507 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.503659 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-67699adb-0d5c-4577-8478-87d581715cd9 req-88678515-4729-4ef9-a563-53b139a8e553 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0804422 Nov 24 16:26:18.522078 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.543992 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 873} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:26:18.559508 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55a1668a-6664-4543-844d-6eb1d55ac0a9,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.567302 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.567530 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Added segment f3c6a933-35bb-4586-9209-7b535731374f of type vlan for network 24dab433-4f5d-49db-b2f0-46e992af618f Nov 24 16:26:18.567637 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Project 34cb226439404c1cbbca2f36b3d8bec4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:26:18.579914 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.611180 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.642451 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.687484 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.688523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:18.689163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.699417 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.721554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c97b985d-cf68-4713-b1a9-c22a4bd178df,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.758420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] Pushing event updated for resources: {'Network': ['ID=24dab433-4f5d-49db-b2f0-46e992af618f,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:18.769136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 24dab433-4f5d-49db-b2f0-46e992af618f details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:26:18.803552 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dde7d178-e8cb-485e-98e3-4950dba11c69 admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6853855 Nov 24 16:26:18.811593 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 51552) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:18.815994 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:18.816513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Request body: {'subnet': {'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-318228158-subnet', 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:18.818186 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d996dc2e-1b07-416a-b5d2-4b32f8400f53 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3689249 Nov 24 16:26:18.821318 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 51554) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:26:18.828407 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'security_group_rule': {'security_group_id': '66a8af55-2ee6-4345-b62d-43183c79c046', 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:18.910414 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:18.912881 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25215965'] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.002202 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Project 34cb226439404c1cbbca2f36b3d8bec4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:26:19.009023 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.074423 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.139426 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.160901 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9f49026-85c9-4645-9d42-b562289a11bc,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:19.168093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-26164714', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25215951'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.219697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.221155 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-21a2df7e-70b8-4eb4-ba5e-746460a3be09 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3982370 Nov 24 16:26:19.223548 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Pushing event updated for resources: {'Subnet': ['ID=0b71499c-2eb4-4056-877a-cc924aa6fe1f,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:19.234974 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Checking segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:19.235276 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Network hostable DHCP agents. Network: 24dab433-4f5d-49db-b2f0-46e992af618f, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:26:19.251919 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3e027be9-86fe-499b-89de-bc9195254358 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.309361 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Network 24dab433-4f5d-49db-b2f0-46e992af618f is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:26:19.395030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 24dab433-4f5d-49db-b2f0-46e992af618f) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:19.399304 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:19.405665 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:19.406434 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9a8783b-d24f-4d6f-ba05-2688c92664a7 None None] Network 24dab433-4f5d-49db-b2f0-46e992af618f requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:19.504147 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c6e4c787-bf77-428c-9c6e-bdb45002443f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6914155 Nov 24 16:26:19.589280 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc4ed2a7-956a-4870-add7-7dc4bc7232fa None None] Network 24dab433-4f5d-49db-b2f0-46e992af618f requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:26:19.693847 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a8684d21-fddf-4b9c-b792-3202a29d136d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:19.698620 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06aecdec-bfd8-4ad4-af02-09a043dc8aad req-fa5fae44-d8c0-4c2c-b6a6-9122ba48563e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:19.705074 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06aecdec-bfd8-4ad4-af02-09a043dc8aad req-fa5fae44-d8c0-4c2c-b6a6-9122ba48563e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0696375 Nov 24 16:26:19.767845 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06aecdec-bfd8-4ad4-af02-09a043dc8aad req-fdeaef18-284d-4530-b9fe-4de80b259be5 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0609553 Nov 24 16:26:19.808171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port a8684d21-fddf-4b9c-b792-3202a29d136d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:19.808544 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:20.019665 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-792f0f1e-98e6-4d3f-8461-033527af1e23 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:20.021124 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-792f0f1e-98e6-4d3f-8461-033527af1e23 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1010294 Nov 24 16:26:20.036327 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-e17bdc6f-8709-4c92-850b-e9bf1f25068e tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/quotas/4e6a8ec37517478d90f3886b61b1beb6 HTTP/1.1" status: 200 len: 375 time: 0.0088751 Nov 24 16:26:20.068347 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-1617b084-22dd-4db0-a90c-5d50cea9b2b3 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0260594 Nov 24 16:26:20.161803 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-9b02539a-26da-490d-bcd4-523532bddaf9 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864716 Nov 24 16:26:20.251902 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-9694e3e2-9fc4-4086-bfa6-fc6dae831842 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834234 Nov 24 16:26:20.356249 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:20.502955 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2baa21f2-ac29-4aa6-a5d0-e8aa50217987 req-54f0d583-f70e-41fb-8c23-4b35c7a4fb39 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0313628 Nov 24 16:26:20.894589 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68aebf87-3ce4-48a2-a702-604170cdd9f8 req-c6eba8b5-9083-4dba-9e6f-2162e82e5784 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:20.896126 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68aebf87-3ce4-48a2-a702-604170cdd9f8 req-c6eba8b5-9083-4dba-9e6f-2162e82e5784 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0563765 Nov 24 16:26:20.944017 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68aebf87-3ce4-48a2-a702-604170cdd9f8 req-8305c867-a6cd-4479-8a79-e75f9a9936a6 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416906 Nov 24 16:26:21.279289 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef97f4b4-8623-43a5-9f44-8f5d99082404 req-0407ef59-2b6d-4cba-949f-343a69497d4d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:21.280887 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ef97f4b4-8623-43a5-9f44-8f5d99082404 req-0407ef59-2b6d-4cba-949f-343a69497d4d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0602014 Nov 24 16:26:21.331505 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ef97f4b4-8623-43a5-9f44-8f5d99082404 req-7ae44626-c878-4a38-9fc7-01f153e9d745 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443385 Nov 24 16:26:21.597723 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5f48560b-f227-4114-9df0-d9ccb5047f82 req-8b505ebf-894d-4a6b-b9d7-acd9c25645b3 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0255399 Nov 24 16:26:21.733679 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:22.424322 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:22.450194 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20687195-1ffd-486a-ac34-af689c9e054e req-ce1a9252-8156-415d-8134-bc964bac720a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:22.451700 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-20687195-1ffd-486a-ac34-af689c9e054e req-ce1a9252-8156-415d-8134-bc964bac720a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0517862 Nov 24 16:26:22.499147 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-20687195-1ffd-486a-ac34-af689c9e054e req-262cbde3-31ac-49b8-b4e9-b6e5aae43c4c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414536 Nov 24 16:26:22.689128 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ab082fa4-8027-412a-a591-0097ae221cd6 req-a5282a1a-927a-4ca5-9052-49cba74c32c9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0265057 Nov 24 16:26:23.631295 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03947cb1-5404-46b0-9635-85147ba67807 req-ffbf29b8-3d85-48ad-8505-d219d988e9ae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:23.633199 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-03947cb1-5404-46b0-9635-85147ba67807 req-ffbf29b8-3d85-48ad-8505-d219d988e9ae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0518146 Nov 24 16:26:23.684208 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-03947cb1-5404-46b0-9635-85147ba67807 req-79425c37-6a3f-484f-8fcc-be6a08eb093b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417812 Nov 24 16:26:23.782606 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-31f0f739-67af-480b-823f-b7ffa8c5453f req-af4f47c0-abec-4657-94b1-beb0d19b19e2 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0269585 Nov 24 16:26:24.444560 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-64504f39-ce8b-4979-b110-467ac839e0d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:24.446646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-64504f39-ce8b-4979-b110-467ac839e0d2 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 1099 time: 0.0415277 Nov 24 16:26:24.542441 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-d763740c-b5fd-4396-aeed-9c47104251ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:24.544084 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-d763740c-b5fd-4396-aeed-9c47104251ad service neutron] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 911 time: 0.0872636 Nov 24 16:26:24.613384 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-8b956ff3-0c96-46b3-869d-d27c79df8a9f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 200 len: 1001 time: 0.0597463 Nov 24 16:26:24.665551 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-22cc3d29-1ade-4d95-bc16-e08e5e8a1ff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:24.666969 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-22cc3d29-1ade-4d95-bc16-e08e5e8a1ff8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.0461698 Nov 24 16:26:24.714775 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-5498fad2-6bfa-44fa-b5fd-7b3d4eb80aae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:24.716330 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-5498fad2-6bfa-44fa-b5fd-7b3d4eb80aae service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413489 Nov 24 16:26:24.805849 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cb2193-ca53-486b-af31-c570b68efae7 req-590fa0c4-375f-4253-97a2-8660ba22494f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:24.807960 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f0cb2193-ca53-486b-af31-c570b68efae7 req-590fa0c4-375f-4253-97a2-8660ba22494f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0533071 Nov 24 16:26:24.821011 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-5c017ce0-3853-45bf-b67a-a004dc1df7ab service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882778 Nov 24 16:26:24.862283 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f0cb2193-ca53-486b-af31-c570b68efae7 req-e5f54c91-9cff-4c59-bff8-ff409300232e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463774 Nov 24 16:26:24.914381 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d3ad52ee-526a-4d9c-93c1-18122e81aa35 req-2e06aab3-1bec-4bd3-a5bd-001fdb178e99 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0541875 Nov 24 16:26:24.947137 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-962e69ab-a6aa-450e-8869-5ed96cae7515 req-7775fb2c-5388-411b-a8c8-57485bb4d6e9 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1141057 Nov 24 16:26:25.351612 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-acaa35e8-7d5a-4c8a-96e9-b78037c60822 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:25.353122 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-acaa35e8-7d5a-4c8a-96e9-b78037c60822 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1039991 Nov 24 16:26:25.374582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Request body: {'port': {'device_id': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'admin_state_up': True, 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:25.584722 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:25.588869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:25.712418 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Allocated IP 172.20.0.4 (24dab433-4f5d-49db-b2f0-46e992af618f/0b71499c-2eb4-4056-877a-cc924aa6fe1f/762850ae-1576-4b2b-ab96-dc7301eb36df) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:25.859542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:25.950815 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:25.983372 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d554564f-8631-4d32-a93a-9e6ea85cc360 req-1fd662c9-7800-4120-b2f2-6445bbfd182a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:25.984873 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d554564f-8631-4d32-a93a-9e6ea85cc360 req-1fd662c9-7800-4120-b2f2-6445bbfd182a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0512478 Nov 24 16:26:25.999435 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Network 24dab433-4f5d-49db-b2f0-46e992af618f is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:26.010476 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:26.030851 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:26.035446 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d554564f-8631-4d32-a93a-9e6ea85cc360 req-e82ec0af-7535-4393-8767-58b4b9fbcb86 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442257 Nov 24 16:26:26.040838 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event updated for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:26.074110 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.074475 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.074827 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.075397 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.075745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.076084 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.076421 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.076756 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.077090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.077419 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.077749 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.078074 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:26.104762 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a125d087-2a2f-451d-9a7f-19b7ceca621a req-9915a422-cb23-4252-8888-972d97603ef1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:26.106282 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a125d087-2a2f-451d-9a7f-19b7ceca621a req-9915a422-cb23-4252-8888-972d97603ef1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 931 time: 0.1164236 Nov 24 16:26:26.111761 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:26.112374 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:26.160791 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a125d087-2a2f-451d-9a7f-19b7ceca621a req-682c973d-6aeb-4d88-9fd4-37680ac32589 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456994 Nov 24 16:26:26.193658 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ccdf6113-6167-4cc2-9d16-0dc062d3b07f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8228478 Nov 24 16:26:27.282563 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7985891a-cd5b-4b7d-a941-a479fc881320 req-5a516adc-8632-404e-9392-90f1de27644c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:27.284054 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7985891a-cd5b-4b7d-a941-a479fc881320 req-5a516adc-8632-404e-9392-90f1de27644c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 931 time: 0.0489945 Nov 24 16:26:27.330086 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7985891a-cd5b-4b7d-a941-a479fc881320 req-85b7716a-7091-446c-9403-8436d6470b32 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396993 Nov 24 16:26:28.441845 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ddbc9f-a1a5-4830-9d63-e2bf68696123 req-60e76b0d-aa73-4faf-9a25-382ffd9a57e0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:28.443582 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14ddbc9f-a1a5-4830-9d63-e2bf68696123 req-60e76b0d-aa73-4faf-9a25-382ffd9a57e0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 931 time: 0.0480585 Nov 24 16:26:28.489896 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14ddbc9f-a1a5-4830-9d63-e2bf68696123 req-ca881058-a014-43b9-8820-b0fb4b62f039 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400677 Nov 24 16:26:28.967109 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Request body: {'port': {'device_id': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:29.012848 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:29.021556 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:29.518100 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 762850ae-1576-4b2b-ab96-dc7301eb36df {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:29.526527 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:29.545776 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Transition to ACTIVE for port object 762850ae-1576-4b2b-ab96-dc7301eb36df will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:26:29.614919 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-905528e1-16a2-4761-8829-fbb42bfc9d37 req-f3bbe5bc-73a8-4321-bd93-18fa25f34c69 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:29.616388 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-905528e1-16a2-4761-8829-fbb42bfc9d37 req-f3bbe5bc-73a8-4321-bd93-18fa25f34c69 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 931 time: 0.0530648 Nov 24 16:26:29.663164 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-905528e1-16a2-4761-8829-fbb42bfc9d37 req-a916e64f-3a20-46b8-90dd-40218019bbc4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400434 Nov 24 16:26:29.711038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:29.767267 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Pushing event updated for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:29.831048 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Attempting to bind port 762850ae-1576-4b2b-ab96-dc7301eb36df on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:29.831381 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Attempting to bind port 762850ae-1576-4b2b-ab96-dc7301eb36df by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:29.831706 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Attempting to bind port 762850ae-1576-4b2b-ab96-dc7301eb36df on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:29.836546 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Port 762850ae-1576-4b2b-ab96-dc7301eb36df on network 24dab433-4f5d-49db-b2f0-46e992af618f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:26:29.836862 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Attempting to bind port 762850ae-1576-4b2b-ab96-dc7301eb36df on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:29.841566 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:29.841899 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Checking segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:29.842285 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Bound using segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:29.842708 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Bound port: 762850ae-1576-4b2b-ab96-dc7301eb36df, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:29.843093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:29.903052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:29.905961 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=762850ae-1576-4b2b-ab96-dc7301eb36df,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:29.984809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:30.022346 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.022972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:30.024339 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] 10.222.0.84 "PUT /v2.0/ports/762850ae-1576-4b2b-ab96-dc7301eb36df HTTP/1.1" status: 200 len: 1093 time: 1.0617149 Nov 24 16:26:30.024799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:30.027051 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14d571a4-723b-44e8-ae42-350258fb19e8" -d '{"events": [{"name": "network-changed", "server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:30.049642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b041bd0-5191-467c-bffe-1a3c87c62f81 service neutron] Pushing event updated for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:30.066006 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-635382b2-ae70-45a8-b34a-9f86c2f26bb7 x-openstack-request-id: req-635382b2-ae70-45a8-b34a-9f86c2f26bb7 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:30.066316 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:30.066553 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-635382b2-ae70-45a8-b34a-9f86c2f26bb7 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:30.067006 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df', 'status': 'completed', 'code': 200} Nov 24 16:26:30.137385 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-b1b81a0e-2ab9-427b-8253-303422405971 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.138866 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-b1b81a0e-2ab9-427b-8253-303422405971 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 1096 time: 0.0442853 Nov 24 16:26:30.236519 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-24be00ad-e4c9-4e8a-b169-d056bc622ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.237885 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-24be00ad-e4c9-4e8a-b169-d056bc622ea6 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0889063 Nov 24 16:26:30.333068 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-f9709e79-a541-42b2-b727-7de825e426df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.334517 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14d571a4-723b-44e8-ae42-350258fb19e8 req-f9709e79-a541-42b2-b727-7de825e426df service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0892396 Nov 24 16:26:30.433616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-46bfb036-1888-4f24-b528-ee5ce70aec42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.435121 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-46bfb036-1888-4f24-b528-ee5ce70aec42 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 1096 time: 0.0404465 Nov 24 16:26:30.482034 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-c9a989ec-39a6-4ad1-ba7f-f325f86015c9 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=762850ae-1576-4b2b-ab96-dc7301eb36df HTTP/1.1" status: 200 len: 217 time: 0.0376813 Nov 24 16:26:30.533071 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-78be1016-7a8b-4bc0-b4fc-1cf382133001 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.534410 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-78be1016-7a8b-4bc0-b4fc-1cf382133001 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 200 len: 854 time: 0.0435939 Nov 24 16:26:30.565901 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-8d85a80b-c378-456b-84a1-3d19cc51b983 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=24dab433-4f5d-49db-b2f0-46e992af618f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0240939 Nov 24 16:26:30.660892 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-ed2e62c5-69d5-4a6e-9bd4-c50fd827b4c3 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866339 Nov 24 16:26:30.774175 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fdad9188-1084-4079-b8a3-ad524aa4fa73 req-8156605f-a64b-4622-b894-2692befe4654 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045768 Nov 24 16:26:30.781905 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ac0a42-6283-41e6-b408-2daa7a4ffe8c req-b9353ec7-7f58-440b-9c6c-7f6e89009e6b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:30.783495 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c7ac0a42-6283-41e6-b408-2daa7a4ffe8c req-b9353ec7-7f58-440b-9c6c-7f6e89009e6b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 943 time: 0.0517328 Nov 24 16:26:30.831398 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c7ac0a42-6283-41e6-b408-2daa7a4ffe8c req-afcf8291-de62-405f-a226-f84a5d06e484 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417953 Nov 24 16:26:31.949012 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d282e2-6503-4585-8e39-107afb521bba req-b2ff7cdd-9e8a-4085-ac27-c3fd18eabe7d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:31.950534 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-61d282e2-6503-4585-8e39-107afb521bba req-b2ff7cdd-9e8a-4085-ac27-c3fd18eabe7d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 943 time: 0.0490615 Nov 24 16:26:32.001546 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-61d282e2-6503-4585-8e39-107afb521bba req-69f370b8-0863-4937-945e-f7a56c44c5fa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451512 Nov 24 16:26:32.957739 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 762850ae-1576-4b2b-ab96-dc7301eb36df details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:26:33.055194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=762850ae-1576-4b2b-ab96-dc7301eb36df,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:33.066410 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '762850ae-1576-4b2b-ab96-dc7301eb36df', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'port_id': '762850ae-1576-4b2b-ab96-dc7301eb36df', 'mac_address': 'fa:16:3e:23:6d:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 873, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0b71499c-2eb4-4056-877a-cc924aa6fe1f', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:26:33.107076 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:33.118836 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 762850ae-1576-4b2b-ab96-dc7301eb36df {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:33.119086 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1716bd-1079-48d2-9f86-81ea00b21721 req-e8b96eb8-0aa6-4d6c-9088-6db772d624b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:33.120582 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7c1716bd-1079-48d2-9f86-81ea00b21721 req-e8b96eb8-0aa6-4d6c-9088-6db772d624b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 943 time: 0.0519512 Nov 24 16:26:33.138238 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=762850ae-1576-4b2b-ab96-dc7301eb36df,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:33.157444 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:26:33.172256 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7c1716bd-1079-48d2-9f86-81ea00b21721 req-d22ecef1-c95a-4dcb-92c6-a31e99c47e45 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455868 Nov 24 16:26:33.200224 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:33.249830 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:33.540875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:26:34.292157 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488c1056-8a05-4c6e-9411-6d7c5d8a3cf5 req-df7efb13-f551-4430-aacc-80861c6966c0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:34.293637 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-488c1056-8a05-4c6e-9411-6d7c5d8a3cf5 req-df7efb13-f551-4430-aacc-80861c6966c0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 944 time: 0.0485289 Nov 24 16:26:34.341887 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-488c1056-8a05-4c6e-9411-6d7c5d8a3cf5 req-aacf3dbf-d461-42c4-820e-0b2aaf2890cb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422461 Nov 24 16:26:34.969280 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 762850ae-1576-4b2b-ab96-dc7301eb36df up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:35.064496 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 762850ae-1576-4b2b-ab96-dc7301eb36df completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:26:35.068435 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 762850ae-1576-4b2b-ab96-dc7301eb36df triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:35.068802 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:35.121300 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-981a3384-bbaa-477e-9742-4e3c3996cf12 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0412862 Nov 24 16:26:35.148920 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:35.171510 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:35.173659 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2b6229d-18dc-42c8-8835-a391281d3f1b" -d '{"events": [{"server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "name": "network-vif-plugged", "status": "completed", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:35.189328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=762850ae-1576-4b2b-ab96-dc7301eb36df,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:35.192871 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-4099b78b-5d71-48f9-9118-5a87444815b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.195804 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-4099b78b-5d71-48f9-9118-5a87444815b7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 1100 time: 0.0469172 Nov 24 16:26:35.214447 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ec8061d-aa33-4910-b9c7-a53c9ce480de x-openstack-request-id: req-7ec8061d-aa33-4910-b9c7-a53c9ce480de {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:35.214884 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "name": "network-vif-plugged", "status": "completed", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:35.215229 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-7ec8061d-aa33-4910-b9c7-a53c9ce480de {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:35.215700 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df', 'code': 200} Nov 24 16:26:35.268641 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:35.320484 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-b3a10de0-ae45-4b04-b5cd-608c68fa20ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.321718 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:35.322193 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-b3a10de0-ae45-4b04-b5cd-608c68fa20ec service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.0941279 Nov 24 16:26:35.396510 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-f7e12632-aedb-44a6-a5fe-5ea2e31478ae service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 200 len: 1002 time: 0.0642080 Nov 24 16:26:35.453642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-eaaae055-5fab-4f30-82bd-25f18256996a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.455182 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-eaaae055-5fab-4f30-82bd-25f18256996a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0456471 Nov 24 16:26:35.464580 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d88cda-98ca-4a97-9a74-7215b03d04fb req-dd25f6c2-cf29-4d37-9386-027d3bd8ffbe tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.466102 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-31d88cda-98ca-4a97-9a74-7215b03d04fb req-dd25f6c2-cf29-4d37-9386-027d3bd8ffbe tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0497830 Nov 24 16:26:35.510584 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-97372098-03fc-4e10-bf85-5e37f7a8759b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.512123 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-97372098-03fc-4e10-bf85-5e37f7a8759b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0483527 Nov 24 16:26:35.529624 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-31d88cda-98ca-4a97-9a74-7215b03d04fb req-4a9ec86b-ef1a-4aab-8da6-54e96396ed8b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547423 Nov 24 16:26:35.638619 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e783e96-5fcf-4ffc-9565-66161d01f9ee req-3c63e6f6-32d3-46de-9a0e-c0e5df40af1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:35.640228 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1e783e96-5fcf-4ffc-9565-66161d01f9ee req-3c63e6f6-32d3-46de-9a0e-c0e5df40af1f service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 1098 time: 0.1109996 Nov 24 16:26:35.664402 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-bf0e4c7d-5a79-4fab-ae8c-74a6e6dbf5ef service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1211290 Nov 24 16:26:35.748064 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1e783e96-5fcf-4ffc-9565-66161d01f9ee req-e2f0ab02-810e-4294-a3ed-29c6b122939e service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899384 Nov 24 16:26:35.777800 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27663e4d-0d7d-4e70-94c7-8fdade035bc6 req-5336b537-d6f3-4a47-ad36-5cc39fd036bd service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036494 Nov 24 16:26:36.656424 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce3d9ff-b68c-44f3-a70f-dfb5f8015802 req-af21c0e3-9fe8-409f-a998-67f7866d02fa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:36.657876 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1ce3d9ff-b68c-44f3-a70f-dfb5f8015802 req-af21c0e3-9fe8-409f-a998-67f7866d02fa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0519845 Nov 24 16:26:36.703751 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1ce3d9ff-b68c-44f3-a70f-dfb5f8015802 req-23497849-426b-48ec-b258-c9e7cc52e5fb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399389 Nov 24 16:26:36.810987 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c7e1fdf-acf3-4663-81d6-1d76a29d2c72 req-9d9400e4-aec9-4759-97b0-10310f03cf8f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:36.812368 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1c7e1fdf-acf3-4663-81d6-1d76a29d2c72 req-9d9400e4-aec9-4759-97b0-10310f03cf8f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0529361 Nov 24 16:26:36.858819 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1c7e1fdf-acf3-4663-81d6-1d76a29d2c72 req-bc50a4a7-dc11-4c5e-ab62-8e711ae08a7f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406101 Nov 24 16:26:37.815942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6731d2-f1e4-4392-a7b7-ec7ab99043bf req-d0aad41f-f4bf-49fb-80bd-c962391f5511 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:37.817300 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-db6731d2-f1e4-4392-a7b7-ec7ab99043bf req-d0aad41f-f4bf-49fb-80bd-c962391f5511 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0474110 Nov 24 16:26:37.862871 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-db6731d2-f1e4-4392-a7b7-ec7ab99043bf req-08a52cc8-2f51-4376-9c1c-d62260351ab2 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398252 Nov 24 16:26:37.971355 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c92ac19-3e73-495c-b3d9-5ee9feb4272f req-736cac94-b4f2-4858-949e-fbbe5a2d7723 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:37.972847 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0c92ac19-3e73-495c-b3d9-5ee9feb4272f req-736cac94-b4f2-4858-949e-fbbe5a2d7723 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0480180 Nov 24 16:26:38.020416 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0c92ac19-3e73-495c-b3d9-5ee9feb4272f req-2575bc1e-f9ed-45d7-bd6c-f33a9830dffd tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413659 Nov 24 16:26:39.142293 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4b120a-7c8b-4181-bc9c-7cb596b562b8 req-5d5d51b0-2545-44ff-a898-c01d1b015ac0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:39.143806 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bd4b120a-7c8b-4181-bc9c-7cb596b562b8 req-5d5d51b0-2545-44ff-a898-c01d1b015ac0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0563343 Nov 24 16:26:39.190635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bd4b120a-7c8b-4181-bc9c-7cb596b562b8 req-4bfb21f6-0d54-4484-86cb-9cbc58d0476f tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407784 Nov 24 16:26:39.344251 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-36ff0ef3-b514-4207-9245-ad1c3a208437 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:39.345589 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-36ff0ef3-b514-4207-9245-ad1c3a208437 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 946 time: 0.0475729 Nov 24 16:26:39.447271 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Deleting port ff67c722-0eb9-4e70-9f72-576a9db06955 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:26:39.447609 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:39.537139 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] For port ff67c722-0eb9-4e70-9f72-576a9db06955, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=ff67c722-0eb9-4e70-9f72-576a9db06955,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:39.537521 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:39.550420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Calling delete_port for ff67c722-0eb9-4e70-9f72-576a9db06955 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:26:39.771160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:39.791633 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['ff67c722-0eb9-4e70-9f72-576a9db06955'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:26:39.799385 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Pushing event deleted for resources: {'Port': ['ID=ff67c722-0eb9-4e70-9f72-576a9db06955,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:39.848827 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] No DVR routers for this DVR port ff67c722-0eb9-4e70-9f72-576a9db06955 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:26:39.851597 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:39.855920 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7f5174e2-6b6a-4edc-8bc4-debe6b50f3ac req-fbb07f3f-683e-4e5b-b254-19424c726ee5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "DELETE /v2.0/ports/ff67c722-0eb9-4e70-9f72-576a9db06955 HTTP/1.1" status: 204 len: 173 time: 0.4958227 Nov 24 16:26:39.859728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'name': 'network-vif-deleted', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:39.859728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5be244d7-d9e9-48fc-99b4-abf21b6bfae3" -d '{"events": [{"server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "name": "network-vif-deleted", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:39.895195 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42ed2872-ef3c-4a35-bef8-551755cca327 x-openstack-request-id: req-42ed2872-ef3c-4a35-bef8-551755cca327 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:39.895512 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "57388af0-a4b3-40be-8b61-b6b04436f788", "name": "network-vif-deleted", "tag": "ff67c722-0eb9-4e70-9f72-576a9db06955", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:39.895770 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-42ed2872-ef3c-4a35-bef8-551755cca327 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:39.896172 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '57388af0-a4b3-40be-8b61-b6b04436f788', 'name': 'network-vif-deleted', 'tag': 'ff67c722-0eb9-4e70-9f72-576a9db06955', 'status': 'completed', 'code': 200} Nov 24 16:26:40.296099 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bc518c80-ecb2-4a86-9819-f56c81ca424b req-6ab94629-34bb-430d-a4d4-972aab157c9a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=57388af0-a4b3-40be-8b61-b6b04436f788 HTTP/1.1" status: 200 len: 210 time: 0.0257332 Nov 24 16:26:41.337381 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-0b2a1360-dc0c-456a-86fa-e1d030220e3e tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-646852380&fields=id&tenant_id=34cb226439404c1cbbca2f36b3d8bec4 HTTP/1.1" status: 200 len: 267 time: 0.0449255 Nov 24 16:26:41.454218 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-86b13595-b053-456c-b6ab-e19982ec853f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:41.455766 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-86b13595-b053-456c-b6ab-e19982ec853f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 809 time: 0.1110039 Nov 24 16:26:41.470433 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-655a1d36-2479-40c9-a837-6ee352e0622a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/quotas/34cb226439404c1cbbca2f36b3d8bec4 HTTP/1.1" status: 200 len: 375 time: 0.0088735 Nov 24 16:26:41.524643 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-a333f0cc-2502-4581-acc9-462de3426913 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0489805 Nov 24 16:26:41.620203 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-250df4b1-2ead-45e1-9eb2-14e5e08c2711 service neutron] 10.222.0.82 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839739 Nov 24 16:26:41.714163 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-7461a639-9040-4e80-9556-dfff8e457536 service neutron] 10.222.0.82 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880809 Nov 24 16:26:42.297172 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-274d36e3-1fdc-487f-a708-2688afd99927 req-3efec9a5-e245-4e63-bc4c-191c4614a524 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0381870 Nov 24 16:26:43.152086 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device ff67c722-0eb9-4e70-9f72-576a9db06955 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:43.172134 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: ff67c722-0eb9-4e70-9f72-576a9db06955 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:43.172473 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device ff67c722-0eb9-4e70-9f72-576a9db06955 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:43.387475 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-85f3237d-fa7a-4c74-abb3-f11f1ff34f69 req-0b165d14-68d5-4b97-b8af-4f78af2de4f6 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0267298 Nov 24 16:26:44.387696 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a99dba-37e5-4b39-97f2-49517c411b17 req-ccf307aa-c91d-4039-bef9-774d55d4eb70 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:44.389098 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d3a99dba-37e5-4b39-97f2-49517c411b17 req-ccf307aa-c91d-4039-bef9-774d55d4eb70 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0492949 Nov 24 16:26:44.449023 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d3a99dba-37e5-4b39-97f2-49517c411b17 req-58c76ec6-30ab-4144-a9d1-e8e131acf8f0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0537775 Nov 24 16:26:44.479349 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2c84f629-b98e-4fe0-b704-ba594a831938 req-887c1475-5295-4cfc-8306-a1def7b4c289 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0255980 Nov 24 16:26:45.239725 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-1ec14ef9-c6cf-4133-855f-86fcf7762071 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:45.241245 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-1ec14ef9-c6cf-4133-855f-86fcf7762071 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1138 time: 0.0467944 Nov 24 16:26:45.340040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-f5d9a242-75a5-4307-8d6c-b67ed0c75718 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:45.341500 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-f5d9a242-75a5-4307-8d6c-b67ed0c75718 service neutron] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 916 time: 0.0907440 Nov 24 16:26:45.412940 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-6c66a320-0f7d-49c2-bb96-b1ce7cea16a3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 1002 time: 0.0623510 Nov 24 16:26:45.476369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-0723ec6c-6caf-4388-9835-002cd8ab12d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:45.477815 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-0723ec6c-6caf-4388-9835-002cd8ab12d2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.0444667 Nov 24 16:26:45.527317 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-5f8c3709-1d6b-44c6-912b-57f329016b92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:45.528813 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-5f8c3709-1d6b-44c6-912b-57f329016b92 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424721 Nov 24 16:26:45.580596 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3b33f53d-9cb0-4f60-9c33-b5c372216b46 req-6eee6aa8-7de5-4a8f-ace7-57c36297a770 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0288141 Nov 24 16:26:45.636432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1f6ce4-66c9-4f33-b940-6af8d6a26c82 req-09fbaf68-fe27-4613-84b3-c40072928e00 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:45.637929 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9d1f6ce4-66c9-4f33-b940-6af8d6a26c82 req-09fbaf68-fe27-4613-84b3-c40072928e00 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.1082525 Nov 24 16:26:45.671798 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-c9b3e5de-049f-4103-91da-4fbfd0a105ae service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1322584 Nov 24 16:26:45.736169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9d1f6ce4-66c9-4f33-b940-6af8d6a26c82 req-460b4712-2e29-4ec9-81a0-b8a2c77eabee tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0919087 Nov 24 16:26:45.789283 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7a66cdec-11ae-456c-b579-b9271e75de92 req-0764b3e0-6ab2-43a1-9eef-323c1ffc029c service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1063223 Nov 24 16:26:46.225079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-a17edf59-9c52-4b57-85ed-45b470165464 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:46.226513 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-a17edf59-9c52-4b57-85ed-45b470165464 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 809 time: 0.1046119 Nov 24 16:26:46.309160 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-39ea0228-353a-41a8-b5bc-9015492e9958 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=34cb226439404c1cbbca2f36b3d8bec4 HTTP/1.1" status: 200 len: 379 time: 0.0619378 Nov 24 16:26:46.324782 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'port': {'device_id': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'admin_state_up': True, 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'security_groups': ['66a8af55-2ee6-4345-b62d-43183c79c046']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:46.498476 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Made reservation on behalf of 34cb226439404c1cbbca2f36b3d8bec4 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:46.501928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:46.635170 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Allocated IP 172.20.0.7 (12b56726-e7d3-442a-83b6-a1eb4c1c5936/0d71b5b1-1ef3-47d2-bee8-078251e998a9/f474946c-13d2-4ac8-a779-c93737b1fb02) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:46.687009 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1f73391a-f93b-44f9-a067-f0cc37c20a1e req-2e652c7d-d728-495c-9c8b-6ff835a537b5 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0302989 Nov 24 16:26:46.776294 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:46.856891 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f25ca6-bf05-4649-a7ac-8acf383469c9 req-f4a46b78-3987-4741-a151-311e5ed364c2 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:46.858415 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-45f25ca6-bf05-4649-a7ac-8acf383469c9 req-f4a46b78-3987-4741-a151-311e5ed364c2 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0527039 Nov 24 16:26:46.881230 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:46.931935 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-196c62de-7011-4e49-804d-eb8dcb9d87a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:46.960535 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:46.969505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:46.971666 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:46.975067 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:46.982231 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-45f25ca6-bf05-4649-a7ac-8acf383469c9 req-572fd826-54c6-4d8b-8718-fa15c429475e tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1175253 Nov 24 16:26:47.032830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:47.033760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.117481 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-6641e534-c9de-46c1-9c92-e4124d9d5ebf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7970572 Nov 24 16:26:47.138143 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Request body: {'port': {'device_id': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:47.195521 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.210504 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-98efa0e0-40c1-4e60-8728-c1f3f888b99a None None] Provisioning complete for port f474946c-13d2-4ac8-a779-c93737b1fb02 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:47.210939 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-98efa0e0-40c1-4e60-8728-c1f3f888b99a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.249289 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-98efa0e0-40c1-4e60-8728-c1f3f888b99a None None] Port f474946c-13d2-4ac8-a779-c93737b1fb02 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:26:47.455191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f474946c-13d2-4ac8-a779-c93737b1fb02 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:47.462568 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.474931 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Transition to ACTIVE for port object f474946c-13d2-4ac8-a779-c93737b1fb02 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:26:47.555808 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.619156 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:47.704444 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Attempting to bind port f474946c-13d2-4ac8-a779-c93737b1fb02 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:47.704875 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Attempting to bind port f474946c-13d2-4ac8-a779-c93737b1fb02 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:47.705303 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Attempting to bind port f474946c-13d2-4ac8-a779-c93737b1fb02 on network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:47.711985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Port f474946c-13d2-4ac8-a779-c93737b1fb02 on network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:26:47.712308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Attempting to bind port f474946c-13d2-4ac8-a779-c93737b1fb02 on network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:47.720337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:47.720685 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Checking segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:47.721077 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Bound using segment: {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:47.721518 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Bound port: f474946c-13d2-4ac8-a779-c93737b1fb02, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d803832-b892-4b8c-b302-2e5f6c49e7b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:47.722728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.799320 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:47.802532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:47.817153 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87d3eb8-31f1-4b02-b616-839efaee4c7a req-fb031afb-9e4e-4262-ae99-6c4891a79924 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:47.818663 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b87d3eb8-31f1-4b02-b616-839efaee4c7a req-fb031afb-9e4e-4262-ae99-6c4891a79924 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0521171 Nov 24 16:26:47.869977 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b87d3eb8-31f1-4b02-b616-839efaee4c7a req-b90f6045-0d3f-445b-9194-4928276d200e tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444064 Nov 24 16:26:47.914391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.962795 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:47.963392 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:47.964838 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] 10.222.0.84 "PUT /v2.0/ports/f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 1093 time: 0.8311636 Nov 24 16:26:47.965287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:47.967745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d" -d '{"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:47.992262 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c735781-4345-48a1-8397-ce1f26b82007 service neutron] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:48.042770 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef3b8c2d-830f-48ef-8af9-ec41c00a236f x-openstack-request-id: req-ef3b8c2d-830f-48ef-8af9-ec41c00a236f {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:48.043344 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:48.043611 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-ef3b8c2d-830f-48ef-8af9-ec41c00a236f {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:48.044023 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'status': 'completed', 'code': 200} Nov 24 16:26:48.118412 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-ac7ed3df-8fcb-4599-a594-dc26bd8bd67d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:48.120764 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-ac7ed3df-8fcb-4599-a594-dc26bd8bd67d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1096 time: 0.0471144 Nov 24 16:26:48.133142 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b4b7bf-fb27-40e3-8d96-ff5f8cabc1e8 req-ca46047e-73e3-44f8-b947-22ed2707fbba tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:48.135337 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-66b4b7bf-fb27-40e3-8d96-ff5f8cabc1e8 req-ca46047e-73e3-44f8-b947-22ed2707fbba tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0657880 Nov 24 16:26:48.201409 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-66b4b7bf-fb27-40e3-8d96-ff5f8cabc1e8 req-e809a526-8d87-4143-addd-9bda4d055920 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0595644 Nov 24 16:26:48.985328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a438c291-5e72-49cf-ba9b-443e09be5bc0 req-a172bbf9-2fcf-4d43-bbb8-f686323f9aff tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:48.986824 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a438c291-5e72-49cf-ba9b-443e09be5bc0 req-a172bbf9-2fcf-4d43-bbb8-f686323f9aff tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0496032 Nov 24 16:26:49.036380 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a438c291-5e72-49cf-ba9b-443e09be5bc0 req-12e3cbf5-8c26-4d07-9f15-2f918d6c06c4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431976 Nov 24 16:26:49.039791 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-a6c52b62-af8e-467c-bd5b-cd019188350d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:49.041521 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-a6c52b62-af8e-467c-bd5b-cd019188350d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1035633 Nov 24 16:26:49.056991 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-fb9d2675-178c-40dd-9fea-b6e0046292c2 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/quotas/4e6a8ec37517478d90f3886b61b1beb6 HTTP/1.1" status: 200 len: 375 time: 0.0093930 Nov 24 16:26:49.114074 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-d43c2408-e71b-46d7-a48a-e6b26e19a124 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0432146 Nov 24 16:26:49.205466 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-730c166b-559b-4a47-b033-5d4ca8ba4dd8 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845432 Nov 24 16:26:49.235740 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4c9a90e9-1b24-4344-b51f-6ccb635748c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:49.297846 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-14b8a456-7aaa-479d-85da-023b0489aa5c service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852354 Nov 24 16:26:49.315493 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ba9c42-63b2-4a83-a4dd-3d55c6a4f0ea req-7a12d826-a102-4dcc-bd7f-da124c1e3094 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:49.317178 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-10ba9c42-63b2-4a83-a4dd-3d55c6a4f0ea req-7a12d826-a102-4dcc-bd7f-da124c1e3094 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0484700 Nov 24 16:26:49.381198 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-10ba9c42-63b2-4a83-a4dd-3d55c6a4f0ea req-7ffb9b82-a09a-42b5-b594-b2c461371ab1 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0573273 Nov 24 16:26:49.560817 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2753c2dd-7e7e-4898-aa51-2cf4295cf3f2 req-e03c304f-7673-4e89-ad78-2a85ac56e3e5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 210 time: 0.0275562 Nov 24 16:26:50.021970 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-dbd20d78-8ce0-4c41-a57a-11bb3dd666fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:50.026849 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-dbd20d78-8ce0-4c41-a57a-11bb3dd666fc service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0921123 Nov 24 16:26:50.158562 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd7eb5d1-36af-4957-b5fd-9aa41195da7e req-0d4d0039-8745-4290-a4de-43afcc257cbc tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:50.160290 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cd7eb5d1-36af-4957-b5fd-9aa41195da7e req-0d4d0039-8745-4290-a4de-43afcc257cbc tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0518966 Nov 24 16:26:50.209384 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cd7eb5d1-36af-4957-b5fd-9aa41195da7e req-0d66ebfd-4ba3-477a-b7e0-555fcb8d5d67 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429955 Nov 24 16:26:50.330842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:50.497932 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882a7e1c-1b1b-4314-92d9-aaba8cd529c5 req-6a677bf5-1827-4211-9414-92d12a2891c9 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:50.499423 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-882a7e1c-1b1b-4314-92d9-aaba8cd529c5 req-6a677bf5-1827-4211-9414-92d12a2891c9 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0526016 Nov 24 16:26:50.557690 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-882a7e1c-1b1b-4314-92d9-aaba8cd529c5 req-6ad1397a-e124-469a-91f7-c3e0033c9fa7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523169 Nov 24 16:26:50.649605 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ac3bade5-ae35-4c8a-a3c3-560dcc1d4dba req-75c956e6-2ec3-4962-8268-e7b54fdb7dd9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 210 time: 0.0260026 Nov 24 16:26:51.052986 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-01c0b50b-b391-4d69-93a6-769463e3bea1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.054439 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d222fe44-6985-4eb4-bf7b-a16b7c6b146d req-01c0b50b-b391-4d69-93a6-769463e3bea1 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0939143 Nov 24 16:26:51.142198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-9e9d1479-cfe8-4562-a773-642e9220a4fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.143788 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-9e9d1479-cfe8-4562-a773-642e9220a4fc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1096 time: 0.0415633 Nov 24 16:26:51.189402 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-2690fe31-d2ab-4204-809e-0021bd6770ff service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 217 time: 0.0336633 Nov 24 16:26:51.241232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-ff8f7fb9-8d47-498a-89e3-f9f1fb58a2af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.242720 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-ff8f7fb9-8d47-498a-89e3-f9f1fb58a2af service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.0426919 Nov 24 16:26:51.326528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-db2f2e80-e5fd-4a4d-9dce-7c5cac14dbca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.328046 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-db2f2e80-e5fd-4a4d-9dce-7c5cac14dbca service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0734847 Nov 24 16:26:51.340486 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1486fd99-9364-485f-a5dc-27158c1a375d req-966156db-abac-42fc-acf0-8c18006cbf63 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.341903 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1486fd99-9364-485f-a5dc-27158c1a375d req-966156db-abac-42fc-acf0-8c18006cbf63 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0587678 Nov 24 16:26:51.443525 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1486fd99-9364-485f-a5dc-27158c1a375d req-474b090a-c616-4843-bb4b-2344b4931f42 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0936635 Nov 24 16:26:51.461826 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-3cbf4657-a34d-4ace-ae10-a73f4a2f7bf1 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1189952 Nov 24 16:26:51.555866 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2a98a4bf-567f-42ab-a75c-4dbb79295851 req-fae06439-275b-4090-a426-f8ce0f57e023 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828078 Nov 24 16:26:51.672459 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3385381-45fb-42e5-a163-a63cff85d197 req-2b532306-665b-4a83-bfa3-0b4a54630a0b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:51.674627 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d3385381-45fb-42e5-a163-a63cff85d197 req-2b532306-665b-4a83-bfa3-0b4a54630a0b tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0503955 Nov 24 16:26:51.715648 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:51.741173 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d3385381-45fb-42e5-a163-a63cff85d197 req-eddd4ecb-c046-4b0d-a2de-90be2c2bfcb0 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0608327 Nov 24 16:26:51.750237 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-adea37a7-1904-4b13-a7de-1f6cb1715753 req-94e4066d-6ed5-49ed-8a5c-5be5925e1b04 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 210 time: 0.0262387 Nov 24 16:26:52.019981 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-2591434f-ddee-47b9-ab64-6172ada54ffb tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:52.021403 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-2591434f-ddee-47b9-ab64-6172ada54ffb tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/networks?id=796ec630-98f3-43e7-992a-da71da73d27a HTTP/1.1" status: 200 len: 814 time: 0.1060474 Nov 24 16:26:52.035778 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-c84d0f12-6d86-48a5-ac08-0b39b0903796 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/quotas/321dd686a448414493dd3fa5f4429d91 HTTP/1.1" status: 200 len: 375 time: 0.0086653 Nov 24 16:26:52.069528 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-4b7bcbca-ac31-4f9c-bc0d-b66b5d72ac70 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0279572 Nov 24 16:26:52.164918 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-597bacfc-f1df-4176-9be0-71e7f44f52ce service neutron] 10.222.0.82 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880849 Nov 24 16:26:52.225113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-cc2376d1-df54-40d5-be28-9766e9231c22 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:52.226576 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-cc2376d1-df54-40d5-be28-9766e9231c22 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1184886 Nov 24 16:26:52.242165 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Request body: {'port': {'device_id': '59091430-6e78-4c62-8816-b0004df079a6', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'admin_state_up': True, 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:52.262074 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-7b0bb72a-c0e2-4d96-92f8-cd807be696d0 service neutron] 10.222.0.82 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904851 Nov 24 16:26:52.445139 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:52.448413 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:52.455118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:52.502210 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ccf555b6-b795-4f9c-a53b-44c0170d98b1 req-92c90524-a2f9-4ef1-a9ce-433a21f6d32e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 210 time: 0.0358548 Nov 24 16:26:52.606037 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86325706-6380-4736-9eab-fdc68d31d4bb req-2fdab2f9-41a8-4e06-8c91-0036d18bb359 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:52.607247 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86325706-6380-4736-9eab-fdc68d31d4bb req-2fdab2f9-41a8-4e06-8c91-0036d18bb359 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0871720 Nov 24 16:26:52.636771 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Allocated IP 172.20.0.13 (24dab433-4f5d-49db-b2f0-46e992af618f/0b71499c-2eb4-4056-877a-cc924aa6fe1f/9c3d5b59-da60-4d20-99e5-8b05cbf4d19d) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:52.665099 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-86325706-6380-4736-9eab-fdc68d31d4bb req-33d8433a-6914-4896-b92d-45dfb13aa1c2 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515876 Nov 24 16:26:52.888397 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460b2e72-bc3d-44ff-810b-2320d66422a0 req-d9df4f56-222c-4a1b-ae61-9e5a9190bded tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:52.889932 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-460b2e72-bc3d-44ff-810b-2320d66422a0 req-d9df4f56-222c-4a1b-ae61-9e5a9190bded tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0525975 Nov 24 16:26:52.960394 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f3b27b5b-bedb-4dbd-b177-3a2889acd0cd req-747267de-431e-4606-9324-8097ae09ef7f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 210 time: 0.0337069 Nov 24 16:26:52.980877 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-460b2e72-bc3d-44ff-810b-2320d66422a0 req-3a31ac34-57b7-4e12-acc1-986f7fb81bb5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0771976 Nov 24 16:26:53.085409 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.183481 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.199539 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:26:53.227824 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Network 24dab433-4f5d-49db-b2f0-46e992af618f is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:53.233322 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:53.236959 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:53.263242 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event updated for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:53.290693 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:53.291345 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.370441 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-1f67b722-3cea-4f96-89c9-5c4bcd2f2e76 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1323133 Nov 24 16:26:53.386202 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Request body: {'port': {'device_id': '59091430-6e78-4c62-8816-b0004df079a6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:53.440989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.612297 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7ee5fb33-4f81-4772-b1a3-df82eed9ae24 req-390e7dff-e512-4861-8a14-85b8fab6c16e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 210 time: 0.0277467 Nov 24 16:26:53.701053 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:53.708772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.720929 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Transition to ACTIVE for port object 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:26:53.793974 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c2fbbf-fc15-442d-b3a8-f8ac554fbc0b req-2915c40b-1e89-40f8-9dab-b9438ccef67b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:53.795541 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e5c2fbbf-fc15-442d-b3a8-f8ac554fbc0b req-2915c40b-1e89-40f8-9dab-b9438ccef67b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0504401 Nov 24 16:26:53.796686 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:53.884525 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Pushing event updated for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:53.906820 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e5c2fbbf-fc15-442d-b3a8-f8ac554fbc0b req-8821198a-0893-4db1-9279-da5be6168dcf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1049900 Nov 24 16:26:53.954500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Attempting to bind port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:53.954761 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Attempting to bind port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:53.955120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Attempting to bind port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:53.959327 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d on network 24dab433-4f5d-49db-b2f0-46e992af618f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:26:53.959647 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Attempting to bind port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:53.964905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:53.965237 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Checking segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:53.965615 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Bound using segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:53.966037 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Bound port: 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:53.966383 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:54.034385 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:54.037759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:54.082403 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89204feb-8b0d-4b94-9699-4296e02ca1b5 req-7b816a2f-2ffc-4412-b61e-f644401b5b17 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.083920 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89204feb-8b0d-4b94-9699-4296e02ca1b5 req-7b816a2f-2ffc-4412-b61e-f644401b5b17 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0483956 Nov 24 16:26:54.087809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966ea277-aae2-485f-a747-3ed37d844609 req-48c6a5f1-c423-40f5-a4fc-df161557f8b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.089314 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-966ea277-aae2-485f-a747-3ed37d844609 req-48c6a5f1-c423-40f5-a4fc-df161557f8b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 944 time: 0.0484443 Nov 24 16:26:54.121789 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:54.148859 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89204feb-8b0d-4b94-9699-4296e02ca1b5 req-c5f8f4f4-fbc0-474d-aa60-ca85ea73041c tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0583570 Nov 24 16:26:54.175938 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-966ea277-aae2-485f-a747-3ed37d844609 req-2c1ffabc-1824-4eac-8f44-75c683d7a83c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805619 Nov 24 16:26:54.209074 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Pushing event updated for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:54.222184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.222184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:54.222184 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-0f321602-e6e8-41b1-9b3f-6d73930481e7 service neutron] 10.222.0.84 "PUT /v2.0/ports/9c3d5b59-da60-4d20-99e5-8b05cbf4d19d HTTP/1.1" status: 200 len: 1094 time: 0.8388925 Nov 24 16:26:54.222184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:54.223306 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42bbd3e0-426b-4306-bccf-fce25d53e736" -d '{"events": [{"name": "network-changed", "server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:54.264582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cde0014f-a7fd-4a92-9166-6f68b35f3c84 x-openstack-request-id: req-cde0014f-a7fd-4a92-9166-6f68b35f3c84 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:54.265191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:54.265191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-cde0014f-a7fd-4a92-9166-6f68b35f3c84 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:54.265520 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', 'status': 'completed', 'code': 200} Nov 24 16:26:54.420253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-3023ab58-78fe-4746-b247-625b1e8ece6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.421760 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-3023ab58-78fe-4746-b247-625b1e8ece6d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 1097 time: 0.1095746 Nov 24 16:26:54.464801 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-6e9c64b9-84c1-4e61-a2f4-1e0a9f483c36 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.466119 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-6e9c64b9-84c1-4e61-a2f4-1e0a9f483c36 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "GET /v2.0/networks?id=796ec630-98f3-43e7-992a-da71da73d27a HTTP/1.1" status: 200 len: 814 time: 0.1527033 Nov 24 16:26:54.516896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Request body: {'port': {'device_id': '307bacab-ab83-4822-8b12-855139bbd294', 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a', 'admin_state_up': True, 'tenant_id': '321dd686a448414493dd3fa5f4429d91'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:54.601173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-44b88279-270b-430d-ad39-e99c5168bed3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.602635 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-44b88279-270b-430d-ad39-e99c5168bed3 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1701159 Nov 24 16:26:54.712567 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-47e42e91-47f3-494e-bbce-938b211929db req-98a8ed65-e421-413d-a7ce-b1e2c9d97cb4 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 210 time: 0.0270991 Nov 24 16:26:54.751032 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd3a7cf-8011-4859-8854-5a54792f3aa7 req-95ca6895-2258-456c-8064-0d650faff77d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.752507 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cfd3a7cf-8011-4859-8854-5a54792f3aa7 req-95ca6895-2258-456c-8064-0d650faff77d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.1214528 Nov 24 16:26:54.780447 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-f511f14d-3171-41ac-95ba-b3d07b1acc37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.781838 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-42bbd3e0-426b-4306-bccf-fce25d53e736 req-f511f14d-3171-41ac-95ba-b3d07b1acc37 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1609151 Nov 24 16:26:54.813177 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cfd3a7cf-8011-4859-8854-5a54792f3aa7 req-9583b8f7-3b61-409d-a851-3a27fe724f77 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544655 Nov 24 16:26:54.829937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Made reservation on behalf of 321dd686a448414493dd3fa5f4429d91 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:26:54.843610 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:54.925273 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-d198d147-1e06-46ab-840f-a00975d902ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:54.926756 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-d198d147-1e06-46ab-840f-a00975d902ef service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 1097 time: 0.0899417 Nov 24 16:26:55.004876 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-52df5487-e2b9-421b-a3c1-263f477f4e09 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d HTTP/1.1" status: 200 len: 217 time: 0.0443439 Nov 24 16:26:55.020766 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163adbd1-56d5-4a82-bb5d-513237b5bb6e req-14fc4877-35ee-4ba3-aca6-f240dd3445d5 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.022241 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-163adbd1-56d5-4a82-bb5d-513237b5bb6e req-14fc4877-35ee-4ba3-aca6-f240dd3445d5 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0497038 Nov 24 16:26:55.047148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Allocated IP 172.20.0.12 (796ec630-98f3-43e7-992a-da71da73d27a/6aa9b822-d992-4b52-b747-b04d55bff714/db695f6a-d904-4558-ab8e-c235cc3cc92a) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:26:55.071019 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-163adbd1-56d5-4a82-bb5d-513237b5bb6e req-9b9b7abc-25d3-4c7a-8354-59542adbe2fa tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427105 Nov 24 16:26:55.073344 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-af02643b-0333-4f9c-9f5c-763269fc1816 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.074796 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-af02643b-0333-4f9c-9f5c-763269fc1816 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 200 len: 854 time: 0.0607619 Nov 24 16:26:55.121105 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-fd7a2e6c-4197-456b-bbfb-e3b92267fe27 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=24dab433-4f5d-49db-b2f0-46e992af618f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331326 Nov 24 16:26:55.289538 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393e5c83-71f0-4750-889a-a214d566f4d3 req-94d71a27-820e-44a5-86f0-3b505cc1e9f9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.291492 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-393e5c83-71f0-4750-889a-a214d566f4d3 req-94d71a27-820e-44a5-86f0-3b505cc1e9f9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 944 time: 0.0496740 Nov 24 16:26:55.333800 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-36bb64ec-ab38-4cf8-ae26-d53d67175f2d service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1989408 Nov 24 16:26:55.349493 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d881ee-b4ae-48cb-9c9c-fcc125fdf5a3 req-32c8d5e5-b9c1-4267-b4c7-bd5a4010403a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.349493 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96d881ee-b4ae-48cb-9c9c-fcc125fdf5a3 req-32c8d5e5-b9c1-4267-b4c7-bd5a4010403a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.1040740 Nov 24 16:26:55.350557 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-393e5c83-71f0-4750-889a-a214d566f4d3 req-b16f8189-7262-43e8-accf-3c502e947d96 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531623 Nov 24 16:26:55.361781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:55.504660 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96d881ee-b4ae-48cb-9c9c-fcc125fdf5a3 req-f315b446-377a-4e95-867f-fc3528b840bf tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1411929 Nov 24 16:26:55.508197 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a2a9987-d280-4616-be0a-0f74492009b8 req-557680d6-8d53-4aad-8724-19b9ed667256 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1579237 Nov 24 16:26:55.548299 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:55.592825 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Network 796ec630-98f3-43e7-992a-da71da73d27a is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:26:55.595765 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:26:55.599396 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:26:55.623481 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Pushing event updated for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:55.650106 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.650714 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:55.716421 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0ff7e591-89f4-42e0-9ea9-dc14ef386e5e tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2049546 Nov 24 16:26:55.733362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Request body: {'port': {'device_id': '307bacab-ab83-4822-8b12-855139bbd294', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:26:55.790073 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:55.829200 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4816651a-25c5-4865-aa06-d62d8087d8f1 req-7e096c8b-8595-4e72-bd5b-caefe931f20c tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.830990 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4816651a-25c5-4865-aa06-d62d8087d8f1 req-7e096c8b-8595-4e72-bd5b-caefe931f20c tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 932 time: 0.0498638 Nov 24 16:26:55.881988 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4816651a-25c5-4865-aa06-d62d8087d8f1 req-6fee2dd4-b6ee-4505-993f-5726640712a8 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443306 Nov 24 16:26:55.973677 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91bb853c-2ff1-49d1-aedf-91ded8616f20 req-fc73838e-4286-49b0-ace5-d5e5f1d9a745 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:55.975148 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-91bb853c-2ff1-49d1-aedf-91ded8616f20 req-fc73838e-4286-49b0-ace5-d5e5f1d9a745 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0775366 Nov 24 16:26:56.065596 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-91bb853c-2ff1-49d1-aedf-91ded8616f20 req-3136e407-ffdc-4f86-83f1-0ffca0d3cb21 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0659983 Nov 24 16:26:56.122245 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id db695f6a-d904-4558-ab8e-c235cc3cc92a {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:56.130173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:56.142055 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Transition to ACTIVE for port object db695f6a-d904-4558-ab8e-c235cc3cc92a will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:26:56.187479 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c0eab94-18c4-4e78-b9c2-a142ba4cdf89 req-db2c5247-0551-469e-87a3-5d6e2d27465d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.188827 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0c0eab94-18c4-4e78-b9c2-a142ba4cdf89 req-db2c5247-0551-469e-87a3-5d6e2d27465d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0472162 Nov 24 16:26:56.206972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:56.237249 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0c0eab94-18c4-4e78-b9c2-a142ba4cdf89 req-10c3d8d8-4544-4dd8-af50-e843ff54ebbf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425158 Nov 24 16:26:56.258208 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Pushing event updated for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:56.326995 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Attempting to bind port db695f6a-d904-4558-ab8e-c235cc3cc92a on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:26:56.327336 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Attempting to bind port db695f6a-d904-4558-ab8e-c235cc3cc92a by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:26:56.327943 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Attempting to bind port db695f6a-d904-4558-ab8e-c235cc3cc92a on network 796ec630-98f3-43e7-992a-da71da73d27a {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:56.332207 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Port db695f6a-d904-4558-ab8e-c235cc3cc92a on network 796ec630-98f3-43e7-992a-da71da73d27a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:26:56.332479 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Attempting to bind port db695f6a-d904-4558-ab8e-c235cc3cc92a on network 796ec630-98f3-43e7-992a-da71da73d27a {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:26:56.337520 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:26:56.338120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Checking segment: {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:26:56.338232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Bound using segment: {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:26:56.338637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Bound port: db695f6a-d904-4558-ab8e-c235cc3cc92a, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '05c68f21-b538-4544-a014-1cd8d8520388', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 856, 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:26:56.339017 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:56.420760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:26:56.424292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:26:56.470197 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285ca89e-9cea-48c8-97bd-625e5a50f301 req-fccb21ee-4c4f-4379-8789-a76a6c4c2032 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.471722 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-285ca89e-9cea-48c8-97bd-625e5a50f301 req-fccb21ee-4c4f-4379-8789-a76a6c4c2032 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 944 time: 0.0524280 Nov 24 16:26:56.508510 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:56.547965 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-285ca89e-9cea-48c8-97bd-625e5a50f301 req-077b2424-1b86-49d5-b1c1-f263a6f45e02 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703874 Nov 24 16:26:56.554044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.554673 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:56.556099 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] 10.222.0.84 "PUT /v2.0/ports/db695f6a-d904-4558-ab8e-c235cc3cc92a HTTP/1.1" status: 200 len: 1094 time: 0.8267944 Nov 24 16:26:56.556542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:56.564227 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165" -d '{"events": [{"name": "network-changed", "server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:56.593161 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fe2a74-226e-4088-a27c-1af4603b0ea1 service neutron] Pushing event updated for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:56.606086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5a50070-839f-420e-9a15-8bb7e747ee3b x-openstack-request-id: req-b5a50070-839f-420e-9a15-8bb7e747ee3b {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:56.606380 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:56.606636 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b5a50070-839f-420e-9a15-8bb7e747ee3b {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:56.607065 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a', 'status': 'completed', 'code': 200} Nov 24 16:26:56.633060 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d18f1f3-bfab-4783-9324-0d67acf83253 req-13102926-479a-40a3-ad6d-7f5dc62af633 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.635084 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d18f1f3-bfab-4783-9324-0d67acf83253 req-13102926-479a-40a3-ad6d-7f5dc62af633 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0559430 Nov 24 16:26:56.685551 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-c501c923-9456-4554-b7d1-655939fd169f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.687077 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-c501c923-9456-4554-b7d1-655939fd169f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 1097 time: 0.0464265 Nov 24 16:26:56.699162 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d18f1f3-bfab-4783-9324-0d67acf83253 req-ffae3b92-a0d7-4b8c-983e-09b6326359ba tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0573432 Nov 24 16:26:56.833314 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-ad380180-b2d5-40d9-a46c-8fc5dfe8d546 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.834681 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-ad380180-b2d5-40d9-a46c-8fc5dfe8d546 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0953491 Nov 24 16:26:56.837417 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-b350069f-2574-4bf6-bbd1-7af9fa0bbd3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:56.838785 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-b350069f-2574-4bf6-bbd1-7af9fa0bbd3a service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=321dd686a448414493dd3fa5f4429d91&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1274700 Nov 24 16:26:57.027047 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-7c417403-043c-4fc8-8e59-27d076ce0156 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.028480 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4fed021b-99b8-4cb2-b8a4-a17c8aa2b165 req-7c417403-043c-4fc8-8e59-27d076ce0156 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1705639 Nov 24 16:26:57.047245 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:26:57.049744 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9025dc1-8439-4a81-adf1-badca613a325 req-9d87f0ce-9ee5-4d31-8bfe-e3d90a34dbd0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.051315 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c9025dc1-8439-4a81-adf1-badca613a325 req-9d87f0ce-9ee5-4d31-8bfe-e3d90a34dbd0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 944 time: 0.0840366 Nov 24 16:26:57.058421 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Deleting port be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:26:57.058759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.157750 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:57.170019 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'port_id': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', 'mac_address': 'fa:16:3e:c4:3d:f9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 873, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0b71499c-2eb4-4056-877a-cc924aa6fe1f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:26:57.191240 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a3a5f0-0723-4ad9-adb9-e0561f16cdd1 req-96764ea9-c898-43b0-b6b6-260d7a1e7b7c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.193094 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f6a3a5f0-0723-4ad9-adb9-e0561f16cdd1 req-96764ea9-c898-43b0-b6b6-260d7a1e7b7c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 947 time: 0.0509472 Nov 24 16:26:57.200882 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c9025dc1-8439-4a81-adf1-badca613a325 req-b8642864-03ce-4562-99be-6edf4784933a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1389730 Nov 24 16:26:57.205833 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-b1e7214d-bc7b-46e2-972b-aa9d81bb39fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.207301 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-b1e7214d-bc7b-46e2-972b-aa9d81bb39fd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=321dd686a448414493dd3fa5f4429d91&device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 1097 time: 0.1225042 Nov 24 16:26:57.209079 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.222622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:57.223141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] For port be934a2b-3080-4139-8519-7b3fdd48d05e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=be934a2b-3080-4139-8519-7b3fdd48d05e,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:57.223513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.243325 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:57.251397 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f6a3a5f0-0723-4ad9-adb9-e0561f16cdd1 req-6550eb7f-2e00-4b17-8cf2-5f0447bccbef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=de2a5fd9-7646-41b3-85bc-62821b2cc1e7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516007 Nov 24 16:26:57.267723 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-444bbd9e-1744-4dac-8cee-f322bd9feda0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a HTTP/1.1" status: 200 len: 217 time: 0.0472703 Nov 24 16:26:57.314061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.360594 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:57.367585 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.367963 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.368313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.369399 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.369941 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.370435 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.370934 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.371438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.371815 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.372148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.372474 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.372794 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:26:57.465327 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0a7b8220-807e-416b-938d-98c4757c2d9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.466767 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-0a7b8220-807e-416b-938d-98c4757c2d9e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=6aa9b822-d992-4b52-b747-b04d55bff714 HTTP/1.1" status: 200 len: 854 time: 0.1796126 Nov 24 16:26:57.528476 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a39927d-a1df-4cfc-89f0-d8b8bae0989d req-6f9ae5cc-5cae-4d29-b55b-ddba54de8b4c tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.529944 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8a39927d-a1df-4cfc-89f0-d8b8bae0989d req-6f9ae5cc-5cae-4d29-b55b-ddba54de8b4c tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.2005568 Nov 24 16:26:57.616428 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:26:57.679906 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-281b8acc-dfcb-4fb4-a498-d2bb6d1c8a9c req-8d936f43-4c3a-4107-a860-a6a3bf3159e5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.681738 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-281b8acc-dfcb-4fb4-a498-d2bb6d1c8a9c req-8d936f43-4c3a-4107-a860-a6a3bf3159e5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 945 time: 0.0604892 Nov 24 16:26:57.738315 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-281b8acc-dfcb-4fb4-a498-d2bb6d1c8a9c req-eca85aea-a258-47fc-8565-4b264cf02857 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499232 Nov 24 16:26:57.845230 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea06fb7-79a4-48f4-bdd9-d4a37b6af677 req-eca8c7b0-1c45-4449-bfca-33505663fe03 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:57.846743 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aea06fb7-79a4-48f4-bdd9-d4a37b6af677 req-eca8c7b0-1c45-4449-bfca-33505663fe03 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0521746 Nov 24 16:26:57.851040 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-d8e3bc02-ea63-4e95-9542-c3bf29703b6e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=796ec630-98f3-43e7-992a-da71da73d27a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3711593 Nov 24 16:26:57.908230 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aea06fb7-79a4-48f4-bdd9-d4a37b6af677 req-80bffaa5-66f1-4205-8509-71e3c276bd35 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0551093 Nov 24 16:26:57.945403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.945773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:57.946093 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Floating IP 31e6eff1-5214-42c6-996e-f177308316bd disassociated. External IP: 172.27.2.100, port: be934a2b-3080-4139-8519-7b3fdd48d05e. Nov 24 16:26:57.946432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Calling delete_port for be934a2b-3080-4139-8519-7b3fdd48d05e owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:26:58.008173 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8a39927d-a1df-4cfc-89f0-d8b8bae0989d req-4d5d1061-a4bf-4755-b05f-46a1c47f2646 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1594605 Nov 24 16:26:58.083062 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-58544260-39b9-4062-a093-a2a622b73549 service neutron] 10.222.0.84 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2148123 Nov 24 16:26:58.220746 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7693d166-242d-4364-b9bf-cd0059ab4ef9 req-caa77180-88d9-419f-82cc-a1ab92ec27ba service neutron] 10.222.0.84 "GET /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1283553 Nov 24 16:26:58.308846 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:58.316697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727b9c00-043c-4967-a131-d865a18d0638 req-4c103d86-65e3-4433-b287-ab8a29ef639b tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:58.318205 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-727b9c00-043c-4967-a131-d865a18d0638 req-4c103d86-65e3-4433-b287-ab8a29ef639b tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 944 time: 0.0494566 Nov 24 16:26:58.342338 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'Port': ['ID=be934a2b-3080-4139-8519-7b3fdd48d05e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:58.372228 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-deb471c9-362d-4850-963b-c791565ccc95 req-6b787b04-4ece-4778-9416-35b142c95a87 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0320065 Nov 24 16:26:58.377480 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-727b9c00-043c-4967-a131-d865a18d0638 req-2e14d8e8-6c16-45f6-8389-2be4fd301be8 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525048 Nov 24 16:26:58.484323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:26:58.592381 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:26:58.603282 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:26:58.614537 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:58.615285 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:26:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:58.632251 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] No DVR routers for this DVR port be934a2b-3080-4139-8519-7b3fdd48d05e on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:26:58.635535 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:58.638930 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-96433678-c528-4b19-90bd-6a6ed87a08a8 req-cafa0464-0ffd-4b01-8a4e-d5f2a286a870 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "DELETE /v2.0/ports/be934a2b-3080-4139-8519-7b3fdd48d05e HTTP/1.1" status: 204 len: 173 time: 1.7868559 Nov 24 16:26:58.639378 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-deleted', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:58.641616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63f55e9c-a943-44c9-8bd2-00cc93b9626d" -d '{"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-deleted", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:58.678446 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8cc5e4d4-52e2-44ea-82c9-e927d7aaac81 x-openstack-request-id: req-8cc5e4d4-52e2-44ea-82c9-e927d7aaac81 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:58.678760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5ede480a-9913-493f-bedc-9103638bc19b", "name": "network-vif-deleted", "tag": "be934a2b-3080-4139-8519-7b3fdd48d05e", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:58.679052 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-8cc5e4d4-52e2-44ea-82c9-e927d7aaac81 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:58.679462 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5ede480a-9913-493f-bedc-9103638bc19b', 'name': 'network-vif-deleted', 'tag': 'be934a2b-3080-4139-8519-7b3fdd48d05e', 'status': 'completed', 'code': 200} Nov 24 16:26:58.732594 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:58.861130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8881eb51-17e3-4d37-8656-2160c50db3a2 req-e0bcd82c-1a5e-4a0d-93ed-eed436ff44d8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:58.862536 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8881eb51-17e3-4d37-8656-2160c50db3a2 req-e0bcd82c-1a5e-4a0d-93ed-eed436ff44d8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 945 time: 0.0563638 Nov 24 16:26:58.911504 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8881eb51-17e3-4d37-8656-2160c50db3a2 req-3ff5497b-591d-4550-a3be-9e2f5eb45a43 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421894 Nov 24 16:26:58.948842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:58.984820 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:26:58.995046 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:26:58.995664 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:26:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:59.047393 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c449ed8-7b09-4be7-bac1-305e7bf0cc69 req-0f851699-da97-4b4f-8d0b-835c623aa6c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:59.048966 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0c449ed8-7b09-4be7-bac1-305e7bf0cc69 req-0f851699-da97-4b4f-8d0b-835c623aa6c7 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0602524 Nov 24 16:26:59.067279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:26:59.070086 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:26:59.126095 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0c449ed8-7b09-4be7-bac1-305e7bf0cc69 req-1678e858-2cd5-4d52-935f-4b4f4dc92adb tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0707307 Nov 24 16:26:59.137993 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13442119-d6d6-4db8-96c5-3d8d9211dd06 req-83d3916c-2552-4879-a8da-439987d643ab tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:59.148114 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-13442119-d6d6-4db8-96c5-3d8d9211dd06 req-83d3916c-2552-4879-a8da-439987d643ab tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0615058 Nov 24 16:26:59.169913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.188498 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-13442119-d6d6-4db8-96c5-3d8d9211dd06 req-379a4350-7379-41f2-8bbd-cd27295b50c0 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426090 Nov 24 16:26:59.188870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:26:59.397374 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:26:59.408226 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:59.412130 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:26:59.412511 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.458708 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'mac_address': 'fa:16:3e:c5:04:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 893, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:26:59.531538 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3d68d9-d855-488d-986d-e7647555dadb req-c8f9027c-a98d-4f87-b1d9-a11fac9f9db0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:26:59.540020 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0c3d68d9-d855-488d-986d-e7647555dadb req-c8f9027c-a98d-4f87-b1d9-a11fac9f9db0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 944 time: 0.0801167 Nov 24 16:26:59.544288 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-80630eab-d744-42c8-931e-1a980cfe6764 req-45ab6062-7882-4b4b-b68a-dc742404b5e9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=5ede480a-9913-493f-bedc-9103638bc19b HTTP/1.1" status: 200 len: 210 time: 0.0541222 Nov 24 16:26:59.553362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.597174 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f474946c-13d2-4ac8-a779-c93737b1fb02 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:26:59.612021 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0c3d68d9-d855-488d-986d-e7647555dadb req-abf697b2-36e0-44ae-b8ab-f58f90a0fb54 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704331 Nov 24 16:26:59.636187 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:59.639977 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.651567 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:26:59.679413 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f401cc45-8b45-41de-954e-b8dafdbe05db None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:26:59.692648 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:26:59.694993 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb3a7748-fb6b-4ab7-8764-ea3731187783" -d '{"events": [{"server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "name": "network-vif-plugged", "status": "completed", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:26:59.711062 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.716522 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:26:59.770834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:26:59.779303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:26:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-303a9285-556e-4301-966f-3a7560f2c7c7 x-openstack-request-id: req-303a9285-556e-4301-966f-3a7560f2c7c7 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:26:59.784422 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "name": "network-vif-plugged", "status": "completed", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:26:59.784807 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-303a9285-556e-4301-966f-3a7560f2c7c7 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:26:59.785300 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', 'code': 200} Nov 24 16:26:59.794022 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:26:59.797104 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:26:59.840801 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: be934a2b-3080-4139-8519-7b3fdd48d05e {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:26:59.841275 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device be934a2b-3080-4139-8519-7b3fdd48d05e not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:26:59.868049 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:00.007412 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['f474946c-13d2-4ac8-a779-c93737b1fb02'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:00.023729 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d560c05b-fa2f-4a56-91b2-2289d4a4f00b None None] New status for floating IP 31e6eff1-5214-42c6-996e-f177308316bd: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:27:00.042998 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f99456-cb97-4761-8680-9fd3e9075142 req-ad9ea84b-692a-4f14-94e6-056cadbd8920 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:00.045722 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d1f99456-cb97-4761-8680-9fd3e9075142 req-ad9ea84b-692a-4f14-94e6-056cadbd8920 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0648022 Nov 24 16:27:00.091937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aa1476b-fd41-4924-af50-3fc86001e8fd req-f26b9d89-26d6-4eb7-840b-9e7ea8554904 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:00.093516 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4aa1476b-fd41-4924-af50-3fc86001e8fd req-f26b9d89-26d6-4eb7-840b-9e7ea8554904 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 1099 time: 0.0498049 Nov 24 16:27:00.112937 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d1f99456-cb97-4761-8680-9fd3e9075142 req-af452807-9f81-404f-b4bb-2dde39843437 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610726 Nov 24 16:27:00.153102 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4aa1476b-fd41-4924-af50-3fc86001e8fd req-c8f3f0fd-03d4-43ad-ba9b-dd34ed452183 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467336 Nov 24 16:27:00.265147 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb7b3e0-f6a1-4668-9c6d-6bcda54da33b req-72eadf0f-1924-4137-9a98-4febfe9b01a6 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:00.267463 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cfb7b3e0-f6a1-4668-9c6d-6bcda54da33b req-72eadf0f-1924-4137-9a98-4febfe9b01a6 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0642402 Nov 24 16:27:00.341096 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cfb7b3e0-f6a1-4668-9c6d-6bcda54da33b req-161b2fa4-9aa0-4f8b-8a16-fe748317640d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0675602 Nov 24 16:27:00.349993 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f06174-f548-4d48-af2b-de0713e2757c req-32d108ee-637f-46ce-a00f-5dd723f3d45a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:00.351539 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-12f06174-f548-4d48-af2b-de0713e2757c req-32d108ee-637f-46ce-a00f-5dd723f3d45a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 944 time: 0.0571117 Nov 24 16:27:00.407211 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-12f06174-f548-4d48-af2b-de0713e2757c req-4849d04c-5620-40be-9844-39399f03418a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496385 Nov 24 16:27:00.693433 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52124) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:00.735553 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef87758-3927-436d-a910-dba0c5b0081e req-937dbe58-5845-4887-80ce-505f0ba8c1d5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:00.737151 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1ef87758-3927-436d-a910-dba0c5b0081e req-937dbe58-5845-4887-80ce-505f0ba8c1d5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 944 time: 0.0551097 Nov 24 16:27:00.748286 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:00.783242 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:00.789559 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1ef87758-3927-436d-a910-dba0c5b0081e req-afc0b249-3467-4429-a81a-6a45e1353b28 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451746 Nov 24 16:27:00.907857 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:00.910402 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:00.911585 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "DELETE /v2.0/security-groups/de2a5fd9-7646-41b3-85bc-62821b2cc1e7 HTTP/1.1" status: 204 len: 168 time: 0.2170813 Nov 24 16:27:00.914525 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52126) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:00.921134 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=de2a5fd9-7646-41b3-85bc-62821b2cc1e7,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:00.928049 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.928185 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.api.v2.resource [None req-7bd0c93c-53c1-4219-b7f6-32d456464475 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] show failed (client error): The resource could not be found. Nov 24 16:27:00.928397 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.928743 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.929061 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7bd0c93c-53c1-4219-b7f6-32d456464475 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups/de2a5fd9-7646-41b3-85bc-62821b2cc1e7 HTTP/1.1" status: 404 len: 347 time: 0.0129950 Nov 24 16:27:00.929175 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.929404 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.929737 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.930064 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.930394 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.930719 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.931699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.932024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.932355 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1a3fad21-9c9e-43a2-bfa1-1b172fc9372e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:00.932494 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52128) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:01.055564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Deleting port bdaccf32-22f3-4dee-9493-0318026d6f60 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:27:01.056470 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.074933 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device db695f6a-d904-4558-ab8e-c235cc3cc92a details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:27:01.078068 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:01.142477 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.142801 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.154846 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Calling delete_port for bdaccf32-22f3-4dee-9493-0318026d6f60 owned by network:floatingip {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:27:01.260763 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70444dc7-662f-46b4-8f59-00fa8a939b58 req-106c3158-b5dd-4d09-858a-83025d7532bb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:01.273550 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-70444dc7-662f-46b4-8f59-00fa8a939b58 req-106c3158-b5dd-4d09-858a-83025d7532bb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0772245 Nov 24 16:27:01.339291 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-70444dc7-662f-46b4-8f59-00fa8a939b58 req-9dc4c39a-b6c3-4a88-bbc1-1efb045073a3 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615048 Nov 24 16:27:01.351695 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:01.365766 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'db695f6a-d904-4558-ab8e-c235cc3cc92a', 'network_id': '796ec630-98f3-43e7-992a-da71da73d27a', 'port_id': 'db695f6a-d904-4558-ab8e-c235cc3cc92a', 'mac_address': 'fa:16:3e:5b:55:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 856, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6aa9b822-d992-4b52-b747-b04d55bff714', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:27:01.395390 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.406647 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.421079 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db695f6a-d904-4558-ab8e-c235cc3cc92a {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:01.425042 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'Port': ['ID=bdaccf32-22f3-4dee-9493-0318026d6f60,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:01.427399 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port f474946c-13d2-4ac8-a779-c93737b1fb02 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:01.437961 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port f474946c-13d2-4ac8-a779-c93737b1fb02 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:01.438351 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.451775 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:01.530738 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24a4293-5fa8-477b-9951-ca04adb52a70 req-7d6b65fd-6154-4360-9673-b565bd89e128 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:01.532202 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c24a4293-5fa8-477b-9951-ca04adb52a70 req-7d6b65fd-6154-4360-9673-b565bd89e128 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.1109111 Nov 24 16:27:01.535232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.538013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.539351 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-0e27944a-07ca-40b8-9e82-a58e991be8cd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "DELETE /v2.0/floatingips/31e6eff1-5214-42c6-996e-f177308316bd HTTP/1.1" status: 204 len: 168 time: 0.6057796 Nov 24 16:27:01.543306 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.557868 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.570936 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdbaf88-f0db-4143-9e36-8938a5c64c2a req-e5e60367-f95f-4cd8-8cb8-aa876151fe93 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:01.573855 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6fdbaf88-f0db-4143-9e36-8938a5c64c2a req-e5e60367-f95f-4cd8-8cb8-aa876151fe93 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 944 time: 0.0904875 Nov 24 16:27:01.627166 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6fdbaf88-f0db-4143-9e36-8938a5c64c2a req-c3910eb3-ef00-4591-a4f7-a69ad252b08e tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466852 Nov 24 16:27:01.628869 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c24a4293-5fa8-477b-9951-ca04adb52a70 req-1834ff57-fe67-4601-a9f8-80c6157394d6 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0830510 Nov 24 16:27:01.643964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:01.658279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:01.704311 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.751651 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:01.786430 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:01.788866 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62f210e6-23e7-4bad-854a-8253c0bd808b" -d '{"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-plugged", "status": "completed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:01.825645 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-818ce8bc-0374-456a-9170-21cbfc839b52 x-openstack-request-id: req-818ce8bc-0374-456a-9170-21cbfc839b52 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:01.825800 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52142) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:01.826699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-plugged", "status": "completed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:01.827173 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-818ce8bc-0374-456a-9170-21cbfc839b52 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:01.827816 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'code': 200} Nov 24 16:27:01.830542 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1054348011', 'description': 'tempest-description--354827323'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:01.897784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:01.934041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9ae24d-9128-48d9-8d67-619223dc582d req-4e5d964b-3b70-471e-b00a-f071eedd4d07 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:01.935548 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9ae24d-9128-48d9-8d67-619223dc582d req-4e5d964b-3b70-471e-b00a-f071eedd4d07 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 945 time: 0.0662596 Nov 24 16:27:01.992449 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['db695f6a-d904-4558-ab8e-c235cc3cc92a'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:02.018385 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9ae24d-9128-48d9-8d67-619223dc582d req-83bdd72f-b7df-4e58-914a-b9287a23e5da tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757015 Nov 24 16:27:02.021624 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.119703 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.149816 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b7c5e72-801f-42bf-b303-f8e17d0bf744,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:02.221287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9423b01c-e939-4282-a208-6102eab152e3 req-b906ca06-1442-4164-a96d-bb31bb04395d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:02.222839 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9423b01c-e939-4282-a208-6102eab152e3 req-b906ca06-1442-4164-a96d-bb31bb04395d service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.0442219 Nov 24 16:27:02.229568 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.230683 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-837b4bfe-c1ac-4e9e-8b59-887b8054caa9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.4039259 Nov 24 16:27:02.233640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52144) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:02.237847 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group_rule': {'security_group_id': '3b7c5e72-801f-42bf-b303-f8e17d0bf744', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:02.296807 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9423b01c-e939-4282-a208-6102eab152e3 req-1971c01b-444c-4a41-a405-2c545e9513bb service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545959 Nov 24 16:27:02.372344 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.418867 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.444051 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54530e2-82a3-4f1d-b39f-4d3a151cf52a req-70131871-3e3e-439f-bdbc-6d447e5fc75c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:02.445503 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a54530e2-82a3-4f1d-b39f-4d3a151cf52a req-70131871-3e3e-439f-bdbc-6d447e5fc75c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0479476 Nov 24 16:27:02.492488 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a54530e2-82a3-4f1d-b39f-4d3a151cf52a req-a8b72986-9972-4bd1-ae4b-2ebb5b5978a9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407367 Nov 24 16:27:02.504068 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.522613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c977f178-91c7-4289-a6d5-9ccdaa72eed6,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:02.604173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.608047 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-fdc232fe-ab27-4983-b047-b306f3b0c7c2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3710339 Nov 24 16:27:02.608390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52152) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:02.612999 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'security_group_rule': {'security_group_id': '3b7c5e72-801f-42bf-b303-f8e17d0bf744', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:02.735517 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.751117 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491203ad-f4cd-4a55-93a3-2249a14c798c req-302afbdb-389b-4faa-8e1d-ea8dccc1b580 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:02.752607 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-491203ad-f4cd-4a55-93a3-2249a14c798c req-302afbdb-389b-4faa-8e1d-ea8dccc1b580 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0505633 Nov 24 16:27:02.778808 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad6fd52-bf0c-4770-81b5-137e0b34b70c req-b479cca3-3115-4dca-a8b0-3a85c5b30d66 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:02.780312 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bad6fd52-bf0c-4770-81b5-137e0b34b70c req-b479cca3-3115-4dca-a8b0-3a85c5b30d66 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0783055 Nov 24 16:27:02.804943 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-491203ad-f4cd-4a55-93a3-2249a14c798c req-466291b9-8bf5-46dd-86e6-fe7c18a6da13 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462556 Nov 24 16:27:02.811509 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.851738 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-bad6fd52-bf0c-4770-81b5-137e0b34b70c req-1a2abda9-f9bc-4197-803a-f891281705d6 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=81430262-9c5c-4867-b9c2-ff9fd333721e&id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0647855 Nov 24 16:27:02.885063 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.901948 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8cbe262-ae4e-46df-9a3b-387bbdc092e4,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:02.964068 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:02.965463 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-a489a456-8c0f-4c85-a967-5b54eb63a607 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3558924 Nov 24 16:27:02.970785 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52168) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:02.975558 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:03.086655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device db695f6a-d904-4558-ab8e-c235cc3cc92a up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:03.098777 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.159475 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2832de63-0aa2-499d-a69a-75cc5e3f0f18 req-d11437d0-46c2-4efe-aef9-9ce39a0cd87a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:03.160847 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2832de63-0aa2-499d-a69a-75cc5e3f0f18 req-d11437d0-46c2-4efe-aef9-9ce39a0cd87a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 945 time: 0.0748665 Nov 24 16:27:03.201695 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port db695f6a-d904-4558-ab8e-c235cc3cc92a completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:03.208005 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port db695f6a-d904-4558-ab8e-c235cc3cc92a triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:03.211708 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.243684 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2832de63-0aa2-499d-a69a-75cc5e3f0f18 req-3f59422d-5e06-49ed-ade0-96067bce38e0 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548916 Nov 24 16:27:03.261224 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.328935 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.385358 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:03.388186 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Allocated IP 172.27.2.118 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/3aaf391b-32d9-4a68-848f-3d34674bc45f) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:03.486622 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.552818 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.588582 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.597899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:03.629907 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:03.632739 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:03.641192 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:03.665770 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=3aaf391b-32d9-4a68-848f-3d34674bc45f,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:03.729397 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.829045 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:03.831855 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7fa95ad6-7bf0-4f4c-bea1-d63fff417a54" -d '{"events": [{"server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "name": "network-vif-plugged", "status": "completed", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:03.848385 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:03.873335 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd2fa201-348e-400e-93a6-a262755ae14b x-openstack-request-id: req-bd2fa201-348e-400e-93a6-a262755ae14b {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:03.873885 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "name": "network-vif-plugged", "status": "completed", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:03.874340 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-bd2fa201-348e-400e-93a6-a262755ae14b {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:03.875111 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a', 'code': 200} Nov 24 16:27:03.935808 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21497845-951d-43ec-aca3-cf8de0d0b4a2 req-6b15cfa1-c3c8-469c-9b39-a22c7e352212 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:03.938436 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-21497845-951d-43ec-aca3-cf8de0d0b4a2 req-6b15cfa1-c3c8-469c-9b39-a22c7e352212 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0572991 Nov 24 16:27:03.994241 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-21497845-951d-43ec-aca3-cf8de0d0b4a2 req-86a13223-a02e-4eb2-8662-673731e15ccf tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488033 Nov 24 16:27:04.030921 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:04.106092 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:04.173848 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=3aaf391b-32d9-4a68-848f-3d34674bc45f,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:04.185305 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:04.254994 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:04.256360 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d9965d67-1539-43d4-b678-7e83de94ec16 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2844706 Nov 24 16:27:04.320018 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3696abc6-ad88-40fd-b4df-0082419232f8 req-677eacf2-cc08-498b-9865-f7c039a2af00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:04.324124 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3696abc6-ad88-40fd-b4df-0082419232f8 req-677eacf2-cc08-498b-9865-f7c039a2af00 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 1099 time: 0.0696187 Nov 24 16:27:04.407221 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3696abc6-ad88-40fd-b4df-0082419232f8 req-10ccc860-0f52-427a-b447-e14b9ec8fd8e service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740345 Nov 24 16:27:04.415621 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe42ecff-d946-4070-8176-ce26a2ee642b req-9db4c3f0-b2f0-4535-b77b-ca50d7e5bfcc tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:04.417050 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fe42ecff-d946-4070-8176-ce26a2ee642b req-9db4c3f0-b2f0-4535-b77b-ca50d7e5bfcc tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0768483 Nov 24 16:27:04.465889 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fe42ecff-d946-4070-8176-ce26a2ee642b req-6f721b46-6f2c-47cc-ba3c-535dfd45309b tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425954 Nov 24 16:27:04.708231 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-10da5b74-592c-4c0b-b5ab-4b21f94ef114 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--1054348011&fields=id&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 267 time: 0.2622077 Nov 24 16:27:04.812909 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-89075765-1673-4645-af89-3deffeaafcbb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:04.814351 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-89075765-1673-4645-af89-3deffeaafcbb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 817 time: 0.0992239 Nov 24 16:27:04.829751 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-3fe423c9-57b5-4397-ae5e-f005fef1dab4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/quotas/bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 375 time: 0.0094991 Nov 24 16:27:04.882769 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-a6bf6973-c209-41c4-b768-a42a779a8c83 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0475454 Nov 24 16:27:04.975945 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-f366c42b-8fc2-4543-9366-b8f2ccd2ea01 service neutron] 10.222.0.82 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805745 Nov 24 16:27:05.067023 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-61fb2cf5-8c18-4010-b3f1-ebf5b42363cf service neutron] 10.222.0.82 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851278 Nov 24 16:27:05.109499 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5da47a1-7371-4468-b12a-1d5aa3b9e598 req-b6bd48b4-15f8-4977-8ba6-1cc4fd9b626c tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:05.111076 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b5da47a1-7371-4468-b12a-1d5aa3b9e598 req-b6bd48b4-15f8-4977-8ba6-1cc4fd9b626c tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0495806 Nov 24 16:27:05.159844 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b5da47a1-7371-4468-b12a-1d5aa3b9e598 req-932deb63-6317-42d9-b1c4-dfa392ac8e3b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429437 Nov 24 16:27:05.287541 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64d1bff0-b185-417e-993c-285c9f01540c req-ceb0dd81-9b3b-4d2c-b244-753fb84bc998 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:05.289054 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-64d1bff0-b185-417e-993c-285c9f01540c req-ceb0dd81-9b3b-4d2c-b244-753fb84bc998 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0626388 Nov 24 16:27:05.300680 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4fda2d87-03e9-47f4-9075-31db51b1347f req-5b14a63b-1b60-4943-ba66-9c218c17ebee tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 210 time: 0.0290022 Nov 24 16:27:05.348136 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-64d1bff0-b185-417e-993c-285c9f01540c req-3ab9b126-a0a2-45c6-9766-ccf7ba821ac2 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531952 Nov 24 16:27:05.370469 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52208) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:05.516991 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9241fce9-dc64-47a3-90d6-426454ea29c0 tempest-TestShelveInstance-915822134 tempest-TestShelveInstance-915822134-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:05.518976 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9241fce9-dc64-47a3-90d6-426454ea29c0 tempest-TestShelveInstance-915822134 tempest-TestShelveInstance-915822134-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1093 time: 0.1468234 Nov 24 16:27:05.521642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52226) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:05.527753 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'fixed_ip_address': '172.20.0.7'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:05.587589 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3678ba-84a2-452c-bd24-8b7e4f63c347 req-ecb10a2c-337a-415e-a585-ef72aaf06ede tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:05.589126 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9b3678ba-84a2-452c-bd24-8b7e4f63c347 req-ecb10a2c-337a-415e-a585-ef72aaf06ede tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0508130 Nov 24 16:27:05.627314 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for floatingip, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:05.640562 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9b3678ba-84a2-452c-bd24-8b7e4f63c347 req-7f7cb284-4eb7-457c-9cbd-683f6b33b3c3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442278 Nov 24 16:27:05.685904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-856c7aec-4fe2-425a-a0b4-fcb1e40bbe17 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:05.687397 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-856c7aec-4fe2-425a-a0b4-fcb1e40bbe17 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1348817 Nov 24 16:27:05.730072 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-3b920e3e-6e98-4f75-98e1-501dfe79e4b7 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/quotas/4e6a8ec37517478d90f3886b61b1beb6 HTTP/1.1" status: 200 len: 375 time: 0.0366590 Nov 24 16:27:05.803898 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-339df2c5-e3f2-4d87-9e1f-29f2ded50057 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0676470 Nov 24 16:27:05.820442 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:05.973739 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-ba5375b5-1ace-4c25-bb19-df6de77ef5ca service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1616170 Nov 24 16:27:06.006397 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Allocated IP 172.27.2.205 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/58fbfd6b-48a9-4541-9604-57788ed702f2) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:06.133174 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-bb239270-201a-45f7-976d-b5ba9bc23c79 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1517482 Nov 24 16:27:06.166388 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:06.279759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:06.322960 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:06.322960 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:06.324265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:06.365934 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'Port': ['ID=58fbfd6b-48a9-4541-9604-57788ed702f2,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:06.408212 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b78f1b91-37f4-4cfc-8c59-b57a0932e6c0 req-fc4f1900-a1a8-4bb7-be43-4ecdf636ada4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 210 time: 0.0446820 Nov 24 16:27:06.468431 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0843c9e3-e9ca-4c6d-a609-2fc0cba2890d req-19c63269-2f5b-4bae-9243-cdeb62492ff5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 210 time: 0.0492849 Nov 24 16:27:06.764999 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2952437d-8273-4493-960a-b4a935b3e33c req-062f02c4-9529-4af8-850d-54a72c9e3319 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:06.766664 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2952437d-8273-4493-960a-b4a935b3e33c req-062f02c4-9529-4af8-850d-54a72c9e3319 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0549507 Nov 24 16:27:06.824609 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2952437d-8273-4493-960a-b4a935b3e33c req-70d044a4-a5e9-4a77-b53f-1ea20d8bb660 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495477 Nov 24 16:27:07.011130 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:07.180898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:07.340103 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:07.425555 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:07.505689 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3993aed2-8e8c-489d-a728-f1203eb8e09f req-0d3a0766-430b-4116-969e-fdf89e4b1546 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 210 time: 0.0293412 Nov 24 16:27:07.543088 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event updated for resources: {'Port': ['ID=58fbfd6b-48a9-4541-9604-57788ed702f2,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:07.560889 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:07.598987 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65cd55ef-10e2-46ad-ab8d-98b7579cc6a2 req-60ef7409-0b9c-4f32-87e9-fbdc2e147bba tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 210 time: 0.0279906 Nov 24 16:27:07.604339 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0e6ab027-e622-4617-9021-8dad58ff0259 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:07.605951 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0e6ab027-e622-4617-9021-8dad58ff0259 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 817 time: 0.2144511 Nov 24 16:27:07.716103 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Floating IP 67b21a89-ff2c-4fcf-affc-d31122957bf0 associated. External IP: 172.27.2.205, port: f474946c-13d2-4ac8-a779-c93737b1fb02. Nov 24 16:27:07.760169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-082218db-9e75-4183-8575-c03facbbab20 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 380 time: 0.1431365 Nov 24 16:27:07.779186 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'port': {'device_id': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'admin_state_up': True, 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'security_groups': ['3b7c5e72-801f-42bf-b303-f8e17d0bf744']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:08.042732 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:27:08.089734 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Made reservation on behalf of bf09fa482f8a4598be8a0e8428809467 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:27:08.093229 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:08.218688 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:27:08.228256 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Sync routers for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:27:08.238091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:08.238789 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:26:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:08.276032 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Allocated IP 172.20.0.8 (32d52469-d493-4e5e-ad0f-a328c47ce499/5326d769-af24-40f0-97f9-e59937e49c37/fb7e7aaa-2995-487d-b9b1-032fa34c8ec9) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:08.329595 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:08.352504 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:08.394877 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-24c01423-d156-4866-9065-2888c9a5385d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8719985 Nov 24 16:27:08.397246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:08.399619 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c" -d '{"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:08.443148 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b92681e9-e10a-4828-b875-f9271f8da733 x-openstack-request-id: req-b92681e9-e10a-4828-b875-f9271f8da733 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:08.443530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:08.443857 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b92681e9-e10a-4828-b875-f9271f8da733 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:08.444244 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'status': 'completed', 'code': 200} Nov 24 16:27:08.450747 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:08.584523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-b803d0e8-a8ab-4730-9404-4147070b3f88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:08.585934 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-b803d0e8-a8ab-4730-9404-4147070b3f88 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.1137862 Nov 24 16:27:08.621007 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4bc2aa3f-bd93-4940-95d5-c71ec17b5779 req-2f0a75d1-d602-4aa3-8de9-c26c1fc5b157 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 210 time: 0.0340993 Nov 24 16:27:08.644329 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:08.666553 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '67b21a89-ff2c-4fcf-affc-d31122957bf0', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'floating_ip_address': '172.27.2.205', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'mac_address': 'fa:16:3e:c5:04:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:06Z', 'updated_at': '2021-11-24T16:27:06Z', 'revision_number': 0, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:08.709796 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Checking router: ea0a4f3c-ff9f-4435-88e9-7e33de04f220 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:27:08.721753 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:08.722674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:26:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:08.732161 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-ae850347-d350-48cf-b7e5-4c8a2598717f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:08.733252 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-ae850347-d350-48cf-b7e5-4c8a2598717f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.2322912 Nov 24 16:27:08.752133 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:08.753244 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff03b7b6-7cba-40c6-ba52-0a9a0a4f7594 req-8c8f49fd-a871-42bb-af83-0f88ca911961 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:08.755371 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ff03b7b6-7cba-40c6-ba52-0a9a0a4f7594 req-8c8f49fd-a871-42bb-af83-0f88ca911961 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 931 time: 0.0675344 Nov 24 16:27:08.755743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Request body: {'port': {'device_id': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'admin_state_up': True, 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:08.765637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:08.781726 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:08.789739 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:08.840672 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ff03b7b6-7cba-40c6-ba52-0a9a0a4f7594 req-6a0deae2-8f49-4083-8904-da4326e114ea tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782330 Nov 24 16:27:08.878972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-bf1ba0df-8ed7-4656-b94e-09d54ec2d0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:08.880641 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-bf1ba0df-8ed7-4656-b94e-09d54ec2d0d3 service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.2619271 Nov 24 16:27:08.896166 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:08.898174 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:08.898811 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:08.997235 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-f1981d14-9400-4b55-b5b2-c9ed69026213 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 999 time: 0.0930471 Nov 24 16:27:09.000700 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-8f28994d-3546-4dc1-96c7-9eb78ef56f56 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2283907 Nov 24 16:27:09.032971 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Request body: {'port': {'device_id': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:09.080475 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:27:09.083970 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:09.093097 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-fea9bbc0-9c0e-4ee6-9386-7b6b6c904d57 None None] Provisioning complete for port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:09.093397 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fea9bbc0-9c0e-4ee6-9386-7b6b6c904d57 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:09.147250 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-13bb289f-8bff-4790-89f0-5d9868151c9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:09.148729 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-13bb289f-8bff-4790-89f0-5d9868151c9c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.1294386 Nov 24 16:27:09.153584 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-fea9bbc0-9c0e-4ee6-9386-7b6b6c904d57 None None] Port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:27:09.180232 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '67b21a89-ff2c-4fcf-affc-d31122957bf0', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'floating_ip_address': '172.27.2.205', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'mac_address': 'fa:16:3e:c5:04:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:06Z', 'updated_at': '2021-11-24T16:27:06Z', 'revision_number': 0, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:09.184899 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:09.207430 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67269968-8832-4e6f-93a8-9899a73dc86e None None] The sync data for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi is: [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '67b21a89-ff2c-4fcf-affc-d31122957bf0', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'floating_ip_address': '172.27.2.205', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'mac_address': 'fa:16:3e:c5:04:2e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:06Z', 'updated_at': '2021-11-24T16:27:06Z', 'revision_number': 0, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:27:09.316037 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-e8e50a06-7a8c-4ec6-9313-c294e12b9f53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:09.317546 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-e8e50a06-7a8c-4ec6-9313-c294e12b9f53 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1340175 Nov 24 16:27:09.407241 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23881c28-e790-4263-b96a-ebf1e949dbb5 None None] New status for floating IP 67b21a89-ff2c-4fcf-affc-d31122957bf0: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:27:09.424931 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Allocated IP 172.20.0.11 (24dab433-4f5d-49db-b2f0-46e992af618f/0b71499c-2eb4-4056-877a-cc924aa6fe1f/4b2ba5f2-f884-41f8-902c-cb9ddc407213) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:09.584318 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-3172ac07-0455-4995-88c5-0e5ed6024412 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2552438 Nov 24 16:27:09.975471 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b39328-533b-4aa0-a174-05df5b9608cb req-a8e13c38-e3d4-4084-9374-eebb6dc14258 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:09.977072 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-55b39328-533b-4aa0-a174-05df5b9608cb req-a8e13c38-e3d4-4084-9374-eebb6dc14258 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 931 time: 0.0492570 Nov 24 16:27:10.023897 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-55b39328-533b-4aa0-a174-05df5b9608cb req-f04801cc-f68f-4b2f-83f1-5cf798eeee7d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402083 Nov 24 16:27:10.029467 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5a33ed28-16b7-4fc0-b489-4c84acb2b93f req-88a7ed81-bd5d-4e52-811c-e48574528c1a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 210 time: 0.0744755 Nov 24 16:27:10.099984 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-dd96e45f-0558-44b7-965e-018478c1b4aa service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4961109 Nov 24 16:27:10.101981 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:10.115139 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.133882 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.138689 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Transition to ACTIVE for port object fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:27:10.155430 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:27:10.200487 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.252315 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:10.258729 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.268954 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df', '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:10.345107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Network 24dab433-4f5d-49db-b2f0-46e992af618f is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:10.353941 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:10.356462 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:10.405040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event updated for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:10.417787 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Attempting to bind port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:27:10.418127 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Attempting to bind port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:27:10.418458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Attempting to bind port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:10.429767 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:10.430413 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.433529 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 on network 32d52469-d493-4e5e-ad0f-a328c47ce499 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:27:10.433850 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Attempting to bind port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 on network 32d52469-d493-4e5e-ad0f-a328c47ce499 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:10.443590 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:27:10.443932 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Checking segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:27:10.444323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Bound using segment: {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:27:10.444766 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Bound port: fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6e646b11-a097-4614-8963-01958065282b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:27:10.445136 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.510850 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:27:10.514046 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:27:10.517961 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-0b9bb3ee-3436-4d86-bbee-5d81d91cac2c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7679136 Nov 24 16:27:10.546678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Request body: {'port': {'device_id': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:10.597564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.630706 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.651597 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:10.652201 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:10.653588 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] 10.222.0.84 "PUT /v2.0/ports/fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 1093 time: 1.6258516 Nov 24 16:27:10.655532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:10.657948 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3aec3a2a-2e00-4842-a39a-e7882295d507" -d '{"events": [{"name": "network-changed", "server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:10.699064 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c84a714-0a1a-4e5d-ac96-2eb42aa6cf72 service neutron] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:10.708745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fde84bc9-8ef3-442e-a525-98b45977bf88 x-openstack-request-id: req-fde84bc9-8ef3-442e-a525-98b45977bf88 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:10.709048 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:10.709307 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-fde84bc9-8ef3-442e-a525-98b45977bf88 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:10.709709 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'status': 'completed', 'code': 200} Nov 24 16:27:10.858530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-d5c42970-3ca1-4292-b1e2-f4ac6ffc8b90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:10.860064 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-d5c42970-3ca1-4292-b1e2-f4ac6ffc8b90 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1096 time: 0.0861161 Nov 24 16:27:11.012683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-5caba3f7-5c60-4eb9-8a5e-eaa24d00ada3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.014122 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-5caba3f7-5c60-4eb9-8a5e-eaa24d00ada3 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=bf09fa482f8a4598be8a0e8428809467&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1295621 Nov 24 16:27:11.082066 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b2ba5f2-f884-41f8-902c-cb9ddc407213 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:11.115867 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:11.170111 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Transition to ACTIVE for port object 4b2ba5f2-f884-41f8-902c-cb9ddc407213 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:27:11.170340 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15aeb5ae-e631-40aa-bcb6-051ef666b0f7 req-d0db3b8d-a623-4c83-92b3-05801d7ff036 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.171868 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-15aeb5ae-e631-40aa-bcb6-051ef666b0f7 req-d0db3b8d-a623-4c83-92b3-05801d7ff036 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 932 time: 0.0556490 Nov 24 16:27:11.186888 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-25c484f1-a2a8-4213-b416-b84d2781c936 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.188380 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3aec3a2a-2e00-4842-a39a-e7882295d507 req-25c484f1-a2a8-4213-b416-b84d2781c936 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1652379 Nov 24 16:27:11.200006 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950d22e9-7029-4219-90f8-93378782edac req-23a028e5-09b0-4f8a-a6a5-69ae35ee32ca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.201502 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-950d22e9-7029-4219-90f8-93378782edac req-23a028e5-09b0-4f8a-a6a5-69ae35ee32ca tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0832405 Nov 24 16:27:11.229659 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-15aeb5ae-e631-40aa-bcb6-051ef666b0f7 req-d256641d-fb3e-4ac1-9694-d4cefee83580 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515425 Nov 24 16:27:11.249678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:11.315086 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-950d22e9-7029-4219-90f8-93378782edac req-38dc299b-c58f-4109-8d20-ba2a4430aa94 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1058991 Nov 24 16:27:11.333341 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Pushing event updated for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:11.358983 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-19c42591-b0b9-4ec4-8302-f3339bd9a4af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.360459 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-19c42591-b0b9-4ec4-8302-f3339bd9a4af service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1096 time: 0.1241956 Nov 24 16:27:11.418083 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-556ad0dc-af39-4632-bf2f-b24784d370c2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 217 time: 0.0411921 Nov 24 16:27:11.449436 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Attempting to bind port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:27:11.449691 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Attempting to bind port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:27:11.450014 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Attempting to bind port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:11.471800 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 on network 24dab433-4f5d-49db-b2f0-46e992af618f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:27:11.472120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Attempting to bind port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:11.482623 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 26, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:27:11.482985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Checking segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:27:11.483366 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Bound using segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:27:11.483788 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Bound port: 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:27:11.484136 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:11.502516 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0e286353-b260-4af8-a683-d2369bbb4144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.503997 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0e286353-b260-4af8-a683-d2369bbb4144 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0654776 Nov 24 16:27:11.584268 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:27:11.589003 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:27:11.591363 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0d6f7867-f107-43b3-a0f8-75f3f4868536 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.592849 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-0d6f7867-f107-43b3-a0f8-75f3f4868536 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0704708 Nov 24 16:27:11.661352 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:11.705907 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.706511 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:11.707897 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] 10.222.0.84 "PUT /v2.0/ports/4b2ba5f2-f884-41f8-902c-cb9ddc407213 HTTP/1.1" status: 200 len: 1094 time: 1.1652520 Nov 24 16:27:11.737622 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-fa32436f-b7fb-4a8c-a9ef-4f2297870b30 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311786 Nov 24 16:27:11.740327 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f936cf83-f174-43fb-a75e-1e6b619e18f4 service neutron] Pushing event updated for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:11.877047 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9ac409f5-b861-4bea-83d9-bea404732f00 req-04e33df2-488a-4fd5-8a17-1c6978e8e235 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220489 Nov 24 16:27:11.884496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-30a69d66-eee0-464e-bed0-9b82525503d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.885851 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-30a69d66-eee0-464e-bed0-9b82525503d0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 1097 time: 0.0668621 Nov 24 16:27:11.936595 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-ee888397-1e85-431b-b044-f560e6118e84 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213 HTTP/1.1" status: 200 len: 217 time: 0.0375021 Nov 24 16:27:11.995071 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-804f6d55-8913-4237-bd90-b4175f23c5b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:11.996514 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-804f6d55-8913-4237-bd90-b4175f23c5b5 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 200 len: 854 time: 0.0441041 Nov 24 16:27:12.031344 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-aa3b4ceb-f3bf-4b0e-be00-69d4482aa9fb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=24dab433-4f5d-49db-b2f0-46e992af618f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239706 Nov 24 16:27:12.124188 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-7814941f-bcea-4c5a-9ece-046845190742 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847654 Nov 24 16:27:12.212508 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e8366de2-7d6e-4ddc-ba02-499f70cc33bb req-2d372578-562b-4c41-91b2-bd9b416c526a service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795157 Nov 24 16:27:12.343300 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f244549-8314-4067-b5cc-cebf09987624 req-e67e9a95-9f9f-413a-9d45-69cbf4c706b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:12.344807 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7f244549-8314-4067-b5cc-cebf09987624 req-e67e9a95-9f9f-413a-9d45-69cbf4c706b1 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 944 time: 0.0484111 Nov 24 16:27:12.391597 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7f244549-8314-4067-b5cc-cebf09987624 req-741e5a61-d7fc-4f15-9843-1b8c5ba8f8ad tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410042 Nov 24 16:27:12.435809 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f3f9d8c-8726-4546-9bbf-23f6801ad77c req-ac17ba04-98bc-429e-bcd6-29799ddeed01 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:12.437276 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8f3f9d8c-8726-4546-9bbf-23f6801ad77c req-ac17ba04-98bc-429e-bcd6-29799ddeed01 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0495780 Nov 24 16:27:12.488497 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8f3f9d8c-8726-4546-9bbf-23f6801ad77c req-5f783db4-cf18-4b9d-8056-5d7a743146d5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454071 Nov 24 16:27:12.710550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:12.712841 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98" -d '{"events": [{"name": "network-changed", "server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:12.747306 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bdcac96-0d94-442e-9fff-e9032efa5f70 x-openstack-request-id: req-3bdcac96-0d94-442e-9fff-e9032efa5f70 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:12.747593 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:12.747843 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3bdcac96-0d94-442e-9fff-e9032efa5f70 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:12.748234 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'status': 'completed', 'code': 200} Nov 24 16:27:12.812986 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-0df7c2e4-6965-4c3b-b5b2-ed7b6ef6ecf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:12.814450 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-0df7c2e4-6965-4c3b-b5b2-ed7b6ef6ecf7 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 1097 time: 0.0393977 Nov 24 16:27:12.915355 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-92bee9c6-58e7-462a-889f-d22174b779fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:12.916760 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-92bee9c6-58e7-462a-889f-d22174b779fc service neutron] 10.222.0.84 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 915 time: 0.0812509 Nov 24 16:27:12.964749 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-aa55c6c1-5dca-49aa-831b-abd794dc1b84 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213 HTTP/1.1" status: 200 len: 217 time: 0.0361912 Nov 24 16:27:13.027068 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-4dc22d67-8f90-47f9-a476-ac134a5d7fb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:13.028522 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-4dc22d67-8f90-47f9-a476-ac134a5d7fb0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 200 len: 854 time: 0.0432923 Nov 24 16:27:13.069915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-01d2ef8b-fd0b-449b-97b7-34294485ab26 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=24dab433-4f5d-49db-b2f0-46e992af618f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238950 Nov 24 16:27:13.123131 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:27:13.171956 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-42f6b172-4bc7-4ad2-9992-49984f1da7ec service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920446 Nov 24 16:27:13.217970 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:13.229464 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:27:13.265270 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:13.277633 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:13.283933 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-af8b59d4-1e34-4f9f-955b-db0a08ad1b98 req-4cc66987-5828-436e-b05c-c868a57e026e service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820060 Nov 24 16:27:13.297197 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:13.395139 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:13.443944 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:13.517794 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d71afa53-4151-4989-a566-47523614c29c req-9de23ea9-0bb7-4c4d-8d5d-9c28c5d79e59 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:13.519321 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d71afa53-4151-4989-a566-47523614c29c req-9de23ea9-0bb7-4c4d-8d5d-9c28c5d79e59 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 944 time: 0.0602794 Nov 24 16:27:13.567808 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d71afa53-4151-4989-a566-47523614c29c req-12427853-72a9-4ac7-aded-30c8a13080cc tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419056 Nov 24 16:27:13.609747 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9620b7-18fd-49ef-ad41-eb61a7ef74e4 req-37058d68-9abf-4273-bb25-ce467ade175e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:13.611269 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6d9620b7-18fd-49ef-ad41-eb61a7ef74e4 req-37058d68-9abf-4273-bb25-ce467ade175e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0494776 Nov 24 16:27:13.658465 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6d9620b7-18fd-49ef-ad41-eb61a7ef74e4 req-3e6147c3-c051-4332-8800-0372d55abb87 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411572 Nov 24 16:27:13.842116 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:14.681813 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4daa3fa5-b520-4206-bad0-4974d7c8fefc req-60e5f15e-900e-4721-974b-dd47ffc67f47 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:14.684369 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4daa3fa5-b520-4206-bad0-4974d7c8fefc req-60e5f15e-900e-4721-974b-dd47ffc67f47 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 944 time: 0.0480864 Nov 24 16:27:14.731467 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4daa3fa5-b520-4206-bad0-4974d7c8fefc req-671903d5-7040-4a2b-8bc2-e5bd2fecf043 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422199 Nov 24 16:27:14.779167 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1cb89ba-1eeb-478b-9bf2-246b96cf1524 req-317fe703-89ca-4b67-b01d-cf41ec0549ff tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:14.780532 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f1cb89ba-1eeb-478b-9bf2-246b96cf1524 req-317fe703-89ca-4b67-b01d-cf41ec0549ff tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0512099 Nov 24 16:27:14.826268 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f1cb89ba-1eeb-478b-9bf2-246b96cf1524 req-6ad65873-10dd-4d8c-a7ad-bbd3e9b5a746 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397668 Nov 24 16:27:15.144005 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4b2ba5f2-f884-41f8-902c-cb9ddc407213 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:27:15.146082 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:15.276690 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:15.287851 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'port_id': '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'mac_address': 'fa:16:3e:b9:68:38', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 873, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0b71499c-2eb4-4056-877a-cc924aa6fe1f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:27:15.321185 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:15.328183 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:15.329869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:15.330214 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:15.363317 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b2ba5f2-f884-41f8-902c-cb9ddc407213 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:15.393230 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:15.434466 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:15.453741 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:15.461230 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:15.464076 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3be3f22-eb12-4cba-8a16-da763b34250f" -d '{"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:15.493782 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:15.503487 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-999afc0d-38fe-4112-b4e4-a7f5818fe04d x-openstack-request-id: req-999afc0d-38fe-4112-b4e4-a7f5818fe04d {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:15.503791 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:15.504043 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-999afc0d-38fe-4112-b4e4-a7f5818fe04d {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:15.504429 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'code': 200} Nov 24 16:27:15.520794 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:15.583926 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:15.633466 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:15.847646 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4b2ba5f2-f884-41f8-902c-cb9ddc407213'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:15.847871 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a151b3-d167-4ea9-8604-5f06a3bdb60e req-f5ee921e-f353-4f12-845e-038984f6d64b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:15.849411 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-55a151b3-d167-4ea9-8604-5f06a3bdb60e req-f5ee921e-f353-4f12-845e-038984f6d64b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 945 time: 0.0498540 Nov 24 16:27:15.851448 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360b92cc-efcf-45c4-a91d-538e7b820e39 req-d882b1ac-61fb-4a93-81e2-b4e4e8651226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:15.854073 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-360b92cc-efcf-45c4-a91d-538e7b820e39 req-d882b1ac-61fb-4a93-81e2-b4e4e8651226 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1098 time: 0.0418768 Nov 24 16:27:15.917722 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-360b92cc-efcf-45c4-a91d-538e7b820e39 req-dc6908c5-0db0-425b-b92c-51621ad7ff10 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550029 Nov 24 16:27:15.922303 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-55a151b3-d167-4ea9-8604-5f06a3bdb60e req-e39241c6-74b9-4a72-9035-0322e74fde9e tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642776 Nov 24 16:27:15.954242 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6f4680-d10b-4d84-b933-82542bd68907 req-77df308d-fbe3-4ced-a102-b239c3c472b5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:15.955737 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b6f4680-d10b-4d84-b933-82542bd68907 req-77df308d-fbe3-4ced-a102-b239c3c472b5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0495009 Nov 24 16:27:16.003314 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b6f4680-d10b-4d84-b933-82542bd68907 req-74919fcf-f4ae-4e89-8ec8-b5be6feb751b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414557 Nov 24 16:27:16.914867 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-075285dc-4ac6-4bb9-a519-ac3697d28a51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:17.046000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdebf30-3625-4491-985b-7d9a86e1791b req-095af64b-8d58-4a0d-bf1c-1ede27d09637 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:17.047652 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ffdebf30-3625-4491-985b-7d9a86e1791b req-095af64b-8d58-4a0d-bf1c-1ede27d09637 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 945 time: 0.0589023 Nov 24 16:27:17.103655 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ffdebf30-3625-4491-985b-7d9a86e1791b req-c025d1e7-6bbe-4d9b-b32a-54246f58e9df tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500057 Nov 24 16:27:17.137140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bab86fd-6a8a-4852-b90d-4e44bdf9ead0 req-90b089d7-5ab0-4974-9ed3-85d1c1cf8c74 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:17.138652 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bab86fd-6a8a-4852-b90d-4e44bdf9ead0 req-90b089d7-5ab0-4974-9ed3-85d1c1cf8c74 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0641701 Nov 24 16:27:17.185287 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bab86fd-6a8a-4852-b90d-4e44bdf9ead0 req-6826111a-b741-4824-8fcb-d3a321871355 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407853 Nov 24 16:27:17.563226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6986122-091d-4301-99ff-7a0269c6a2c5 req-c0b3e69f-a6a9-4531-b814-77b399a7510b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:17.564700 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e6986122-091d-4301-99ff-7a0269c6a2c5 req-c0b3e69f-a6a9-4531-b814-77b399a7510b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0522935 Nov 24 16:27:17.611842 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e6986122-091d-4301-99ff-7a0269c6a2c5 req-b5feaa70-df17-4b48-970d-cfae4f12b114 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411513 Nov 24 16:27:18.271351 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb3225e-c914-43cc-aca1-2dd23c90af0e req-ae91a0e2-db41-4edd-a51d-f3efa9a004d0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:18.272893 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1eb3225e-c914-43cc-aca1-2dd23c90af0e req-ae91a0e2-db41-4edd-a51d-f3efa9a004d0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 945 time: 0.1007969 Nov 24 16:27:18.321792 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1eb3225e-c914-43cc-aca1-2dd23c90af0e req-8132f8dd-c5ab-4fa6-915c-71301a524ad0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419004 Nov 24 16:27:18.355963 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44e0f67-0ff9-4fe9-9fad-00a06d08343a req-ceb750a6-a979-4872-9968-0e6e4f73dbf1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:18.357446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b44e0f67-0ff9-4fe9-9fad-00a06d08343a req-ceb750a6-a979-4872-9968-0e6e4f73dbf1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0999236 Nov 24 16:27:18.414830 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b44e0f67-0ff9-4fe9-9fad-00a06d08343a req-1ab42d4b-b855-4ef7-8632-eade599a92bd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446129 Nov 24 16:27:18.729748 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b559c272-af06-4e64-ada1-2e62d496b33f req-8e4d0676-a6a2-441b-80e1-9880fd2e4de1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:18.731262 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b559c272-af06-4e64-ada1-2e62d496b33f req-8e4d0676-a6a2-441b-80e1-9880fd2e4de1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0522408 Nov 24 16:27:18.781007 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b559c272-af06-4e64-ada1-2e62d496b33f req-f805a9ce-2bdb-4588-a0e7-573bbe6af7e1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436552 Nov 24 16:27:19.227180 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bc8d77b1-52a5-44a8-bfe6-93e81800dfd0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:19.443176 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d69877a-f853-46af-a3f6-ca5aaa8626e2 req-bba5cd9f-99d9-4b8c-aa16-debc5e82373f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:19.444671 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6d69877a-f853-46af-a3f6-ca5aaa8626e2 req-bba5cd9f-99d9-4b8c-aa16-debc5e82373f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 945 time: 0.0477920 Nov 24 16:27:19.496326 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6d69877a-f853-46af-a3f6-ca5aaa8626e2 req-a13d6f9a-1e11-4794-b565-eec4e36f4656 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449479 Nov 24 16:27:19.536814 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40fc7e30-62fc-4e91-a5cf-f899e3da680f req-db4ec883-a393-4b93-a6a1-a75852afa7d5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:19.538256 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-40fc7e30-62fc-4e91-a5cf-f899e3da680f req-db4ec883-a393-4b93-a6a1-a75852afa7d5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0493667 Nov 24 16:27:19.585187 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-40fc7e30-62fc-4e91-a5cf-f899e3da680f req-64b4a7a5-c131-4ba5-b95d-3914922217f4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410058 Nov 24 16:27:19.900248 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d236cd-2410-438c-af62-1b9c474a3fcd req-01d86cc1-8987-408a-8652-d77d1e7bf20d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:19.902311 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b4d236cd-2410-438c-af62-1b9c474a3fcd req-01d86cc1-8987-408a-8652-d77d1e7bf20d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0549016 Nov 24 16:27:19.948044 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b4d236cd-2410-438c-af62-1b9c474a3fcd req-60754750-71b9-4f58-9e84-ccb4695069a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390208 Nov 24 16:27:20.366058 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:20.610803 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12ba0b0-5eed-4cfc-84fb-6f82bb09ecca req-566d086b-9ad4-43da-a16a-a0150b9b524c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:20.612017 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e12ba0b0-5eed-4cfc-84fb-6f82bb09ecca req-566d086b-9ad4-43da-a16a-a0150b9b524c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 945 time: 0.0506051 Nov 24 16:27:20.661828 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e12ba0b0-5eed-4cfc-84fb-6f82bb09ecca req-ffc6234b-2868-43c3-8636-c81874924c21 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429330 Nov 24 16:27:20.705173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a66fb384-75fc-415b-a91d-772dc77a9161 req-ae57823f-f2cd-46e3-a111-34f36708ae7e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:20.706672 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a66fb384-75fc-415b-a91d-772dc77a9161 req-ae57823f-f2cd-46e3-a111-34f36708ae7e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0495002 Nov 24 16:27:20.757415 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a66fb384-75fc-415b-a91d-772dc77a9161 req-330b1579-6d07-4444-a7ee-ccc28f67381f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442262 Nov 24 16:27:21.065035 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4694d2-d7e5-4397-9f77-66ff37afa8cd req-9c4c95fc-8e34-4e29-8480-4efbc1b3c7bb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:21.066574 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ea4694d2-d7e5-4397-9f77-66ff37afa8cd req-9c4c95fc-8e34-4e29-8480-4efbc1b3c7bb tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0524838 Nov 24 16:27:21.115231 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ea4694d2-d7e5-4397-9f77-66ff37afa8cd req-8472faf8-9bfa-45a3-9502-993f55b52638 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409172 Nov 24 16:27:21.169347 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4b2ba5f2-f884-41f8-902c-cb9ddc407213 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:21.284129 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:21.287944 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:21.288324 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:21.367179 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:21.389438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:21.391675 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba6d9aa4-0027-4dc9-86ff-12fc69495842" -d '{"events": [{"server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "name": "network-vif-plugged", "status": "completed", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:21.407328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:21.427049 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fb0b1a4-41d3-4dfc-ad65-7b9222439e2f x-openstack-request-id: req-3fb0b1a4-41d3-4dfc-ad65-7b9222439e2f {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:21.427364 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "name": "network-vif-plugged", "status": "completed", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:21.427650 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3fb0b1a4-41d3-4dfc-ad65-7b9222439e2f {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:21.428128 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'code': 200} Nov 24 16:27:21.497984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:21.544021 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:21.732133 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:21.773926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db144532-295a-45bf-b1bb-b1f53ffe1113 req-f0ba71ef-2d7a-4f1d-88c8-438cbefba41a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:21.775435 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-db144532-295a-45bf-b1bb-b1f53ffe1113 req-f0ba71ef-2d7a-4f1d-88c8-438cbefba41a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0487411 Nov 24 16:27:21.823428 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-db144532-295a-45bf-b1bb-b1f53ffe1113 req-de44f206-046a-4f10-82eb-0d6cc9f901aa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409169 Nov 24 16:27:21.881470 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6ecc36-3a5e-4cf7-94ba-25cc38562fa6 req-ddee2edb-d817-4e75-b53a-82824dad158e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:21.882953 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5e6ecc36-3a5e-4cf7-94ba-25cc38562fa6 req-ddee2edb-d817-4e75-b53a-82824dad158e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0517409 Nov 24 16:27:21.940277 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-5e6ecc36-3a5e-4cf7-94ba-25cc38562fa6 req-2892169a-62c0-497c-8834-fb6a474411db tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462515 Nov 24 16:27:22.051452 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f4289d1-fff3-4b9c-b58c-a68f95a61010 req-3d1b61eb-2d4f-414a-8145-7a38567abd67 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:22.053072 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0f4289d1-fff3-4b9c-b58c-a68f95a61010 req-3d1b61eb-2d4f-414a-8145-7a38567abd67 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0474505 Nov 24 16:27:22.061935 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52392) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:22.066285 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Request body: {'floatingip': {'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:22.111177 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:22.228984 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1583c14e-b514-4b1f-942f-f03060ba2553 req-6decd4c5-5720-46f8-ac9b-173ea1effd0f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:22.230449 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1583c14e-b514-4b1f-942f-f03060ba2553 req-6decd4c5-5720-46f8-ac9b-173ea1effd0f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0499046 Nov 24 16:27:22.277991 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1583c14e-b514-4b1f-942f-f03060ba2553 req-a9e71f76-0a0f-4f69-9fc4-4e3b1ec8f1c4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416026 Nov 24 16:27:22.418098 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:22.539324 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:22.589719 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:22.687129 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Floating IP 1c213342-7604-4648-a8a2-2a4a04942879 associated. External IP: 172.27.2.118, port: fb7e7aaa-2995-487d-b9b1-032fa34c8ec9. Nov 24 16:27:22.892096 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:27:22.981208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0a7488-52f1-45da-822e-4c619b90e812 req-16f64ad6-f630-475a-916d-ed09f28698a7 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:22.982693 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ad0a7488-52f1-45da-822e-4c619b90e812 req-16f64ad6-f630-475a-916d-ed09f28698a7 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0933361 Nov 24 16:27:23.067620 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:27:23.073344 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:23.078033 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:27:23.079187 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ad0a7488-52f1-45da-822e-4c619b90e812 req-bc4c2512-7bd3-42f6-9e7f-2bd57b3c3df8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905519 Nov 24 16:27:23.089248 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:23.090036 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:23.106697 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-92183db6-0c17-4f92-9ef4-cdae223de532 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "PUT /v2.0/floatingips/1c213342-7604-4648-a8a2-2a4a04942879 HTTP/1.1" status: 200 len: 991 time: 1.0411394 Nov 24 16:27:23.106697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:23.108555 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a986925f-d9d1-48f6-ab74-64d6162a2f89" -d '{"events": [{"name": "network-changed", "server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:23.144887 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c92896c5-779e-44dd-9b1e-e08a9ee16674 x-openstack-request-id: req-c92896c5-779e-44dd-9b1e-e08a9ee16674 {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:23.145366 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:23.145784 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c92896c5-779e-44dd-9b1e-e08a9ee16674 {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:23.147166 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'status': 'completed', 'code': 200} Nov 24 16:27:23.218171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:23.394124 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd4e5a5-ea8c-4318-a3bf-2f2e2ecc99db req-59dbb704-644e-4a5a-b30b-f9f367e3557a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:23.395543 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3dd4e5a5-ea8c-4318-a3bf-2f2e2ecc99db req-59dbb704-644e-4a5a-b30b-f9f367e3557a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0488009 Nov 24 16:27:23.440550 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '1c213342-7604-4648-a8a2-2a4a04942879', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.118', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:03Z', 'updated_at': '2021-11-24T16:27:22Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:23.441882 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3dd4e5a5-ea8c-4318-a3bf-2f2e2ecc99db req-f751ccc8-f996-4cad-b4e8-31e0a6cf9870 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404923 Nov 24 16:27:23.466345 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:27:23.474774 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:23.475450 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:23.583688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:23.801754 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '1c213342-7604-4648-a8a2-2a4a04942879', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.118', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:03Z', 'updated_at': '2021-11-24T16:27:22Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:23.829668 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-018ae868-3b18-4900-8e8d-321502a44871 None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '1c213342-7604-4648-a8a2-2a4a04942879', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'floating_ip_address': '172.27.2.118', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:03Z', 'updated_at': '2021-11-24T16:27:22Z', 'revision_number': 1, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:27:24.024717 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33264862-4c5f-487a-9460-48b20178a8bb None None] New status for floating IP 1c213342-7604-4648-a8a2-2a4a04942879: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:27:24.210113 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ce8836-a33f-4378-ad39-83f259246563 req-b5e9c867-9b55-4375-958f-ae76812dfeee tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:24.211622 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b5ce8836-a33f-4378-ad39-83f259246563 req-b5e9c867-9b55-4375-958f-ae76812dfeee tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0584524 Nov 24 16:27:24.263156 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b5ce8836-a33f-4378-ad39-83f259246563 req-cf86cc1a-bdc2-428f-96fb-39a684c46d07 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454462 Nov 24 16:27:24.557059 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50aa0c7a-2ba7-4c2a-b894-9062b66b6c2f req-1f939061-d291-4f19-a2f8-7470894caf6c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:24.558529 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-50aa0c7a-2ba7-4c2a-b894-9062b66b6c2f req-1f939061-d291-4f19-a2f8-7470894caf6c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0492237 Nov 24 16:27:24.605437 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-50aa0c7a-2ba7-4c2a-b894-9062b66b6c2f req-d3a50fd9-8123-4975-b16e-f662bd7d91c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409501 Nov 24 16:27:24.701087 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c46ff7e9-db6a-4c02-914a-b5f25a49a713 req-80ec0831-82c3-464a-a3a9-0ab2d9d5ad9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:24.702587 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c46ff7e9-db6a-4c02-914a-b5f25a49a713 req-80ec0831-82c3-464a-a3a9-0ab2d9d5ad9c service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 1099 time: 0.0712984 Nov 24 16:27:24.706574 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-42932855-5222-4134-b4c6-3aeb4dfb3055 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:24.707968 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-42932855-5222-4134-b4c6-3aeb4dfb3055 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1098 time: 0.0528874 Nov 24 16:27:24.816776 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c46ff7e9-db6a-4c02-914a-b5f25a49a713 req-7c8e3b24-e5e9-4612-ace8-2a2c1d4e37dd service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946331 Nov 24 16:27:24.833906 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-f4860934-defb-4185-b911-ad42de9a29fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:24.835326 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-f4860934-defb-4185-b911-ad42de9a29fd service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.1082463 Nov 24 16:27:25.183983 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-da628c62-45f0-47bd-8f3f-9ac3a8e0e7a1 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 1001 time: 0.0594242 Nov 24 16:27:25.243432 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-bbf9d825-3634-4fbb-8f3e-131224215700 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:25.245394 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-bbf9d825-3634-4fbb-8f3e-131224215700 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0439150 Nov 24 16:27:25.297566 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-00f4c92a-0d07-490f-aecd-4730f770eb30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:25.299282 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-00f4c92a-0d07-490f-aecd-4730f770eb30 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437486 Nov 24 16:27:25.379761 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5350d40d-2a1c-4974-9545-103889586631 req-02ee8474-6430-45e9-87f6-c540140e28e4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:25.381259 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5350d40d-2a1c-4974-9545-103889586631 req-02ee8474-6430-45e9-87f6-c540140e28e4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0475581 Nov 24 16:27:25.397174 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-1587c303-1b96-4728-9344-f469f74af7b9 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844171 Nov 24 16:27:25.431145 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5350d40d-2a1c-4974-9545-103889586631 req-f3748016-d2d6-4cdc-bd78-1c1422eee23f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432360 Nov 24 16:27:25.499040 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a986925f-d9d1-48f6-ab74-64d6162a2f89 req-5a9785f9-9951-4706-9b29-74924842a5f3 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881827 Nov 24 16:27:25.722665 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145008ef-8d57-4c7a-8ffe-edd9b4a601b1 req-9bcd73e6-597b-4c2e-a9de-74bddc20b307 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:25.724169 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-145008ef-8d57-4c7a-8ffe-edd9b4a601b1 req-9bcd73e6-597b-4c2e-a9de-74bddc20b307 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0485451 Nov 24 16:27:25.771677 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-145008ef-8d57-4c7a-8ffe-edd9b4a601b1 req-8e12588d-b710-404a-8d55-062d3c89549c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410089 Nov 24 16:27:26.548548 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefaa500-578d-4f44-bbc2-f006833ec237 req-75c66917-d8fb-4419-a64a-e676a186f1bd tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:26.550043 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cefaa500-578d-4f44-bbc2-f006833ec237 req-75c66917-d8fb-4419-a64a-e676a186f1bd tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0485790 Nov 24 16:27:26.596845 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cefaa500-578d-4f44-bbc2-f006833ec237 req-e076a8b0-347b-4cb2-9df4-379c1ace13cf tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408709 Nov 24 16:27:26.888604 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00dee412-8081-4d8d-ba64-f2013d0d7760 req-57988dd4-2b3a-4fd5-954a-d4a738655554 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:26.890220 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-00dee412-8081-4d8d-ba64-f2013d0d7760 req-57988dd4-2b3a-4fd5-954a-d4a738655554 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0493014 Nov 24 16:27:26.936894 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-00dee412-8081-4d8d-ba64-f2013d0d7760 req-8220f068-d1c3-4b51-af18-2defd0b93cb3 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408423 Nov 24 16:27:27.015318 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-0e5488cd-b39a-4637-a6d1-90f341eaee14 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:27.016858 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-0e5488cd-b39a-4637-a6d1-90f341eaee14 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 946 time: 0.0480721 Nov 24 16:27:27.133416 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Deleting port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:27:27.133672 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:27.223480 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] For port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:27.223841 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:27.391760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:27.392038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:27.392349 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Floating IP bce43c38-c74a-41bb-a9e8-0064c3b81952 disassociated. External IP: 172.27.2.92, port: a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5. Nov 24 16:27:27.392681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Calling delete_port for a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:27:27.612513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:27.648070 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'Port': ['ID=a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:27.661316 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.661679 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.662039 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.662365 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.662704 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.663070 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.663407 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.663742 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.664079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.664406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.664732 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:27.665058 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:28.077448 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89ee21e-ca5c-4f4d-b16f-ee3281e42271 req-0564dc08-e77a-4ebe-83fb-19bff93dbff4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:28.079043 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a89ee21e-ca5c-4f4d-b16f-ee3281e42271 req-0564dc08-e77a-4ebe-83fb-19bff93dbff4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.3752372 Nov 24 16:27:28.084486 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fef0e174-4e12-4c02-83e1-3a4f19865113 req-3f92393b-53c5-4967-b01c-114a69a08f3c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0333915 Nov 24 16:27:28.125435 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:27:28.155716 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a89ee21e-ca5c-4f4d-b16f-ee3281e42271 req-b06ff372-fe89-4773-b14f-74ba54b0c3e6 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634885 Nov 24 16:27:28.254711 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:27:28.265834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:27:28.276021 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:28.276635 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:28.294152 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] No DVR routers for this DVR port a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:27:28.296675 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:28.300063 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1cf914d0-a7ca-4d44-bf16-401b47c47130 req-523f3bc4-b973-45e3-b1a8-ce8533d347fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "DELETE /v2.0/ports/a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 HTTP/1.1" status: 204 len: 173 time: 1.2551966 Nov 24 16:27:28.300624 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'name': 'network-vif-deleted', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:28.302875 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d1809b3-5de9-4187-90f3-078f4a036454" -d '{"events": [{"server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "name": "network-vif-deleted", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:28.339482 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b97c29d0-cc77-458d-bd1b-c285338f003e x-openstack-request-id: req-b97c29d0-cc77-458d-bd1b-c285338f003e {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:28.339776 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f5ee0ed0-9bc2-456a-84d8-44f80cd360b2", "name": "network-vif-deleted", "tag": "a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:28.340030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b97c29d0-cc77-458d-bd1b-c285338f003e {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:28.340434 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f5ee0ed0-9bc2-456a-84d8-44f80cd360b2', 'name': 'network-vif-deleted', 'tag': 'a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5', 'status': 'completed', 'code': 200} Nov 24 16:27:28.396266 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:28.598067 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:28.628440 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:27:28.637565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:28.638170 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:28.874644 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:29.089319 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:29.125679 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:29.126538 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd50749d-1a12-4e0d-bfee-88f6e843c162 None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:27:29.209357 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4a9d1c08-d4f8-469d-bc6c-f4019a7ee409 req-2cac60b3-d3ab-4404-baaa-68b09bcf8f4b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f5ee0ed0-9bc2-456a-84d8-44f80cd360b2 HTTP/1.1" status: 200 len: 210 time: 0.0310433 Nov 24 16:27:29.374489 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c21a7b45-3aeb-4aeb-b233-e73b2ea334bd None None] New status for floating IP bce43c38-c74a-41bb-a9e8-0064c3b81952: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:27:30.423955 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52494) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:30.479410 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.502424 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.633094 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.636366 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.637638 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "DELETE /v2.0/security-groups/b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3 HTTP/1.1" status: 204 len: 168 time: 0.2126808 Nov 24 16:27:30.640495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52498) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:30.646603 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af53ae3-a2db-43f6-81c2-6d967c8ae8a9 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:30.657327 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.api.v2.resource [None req-50aa2d6a-fdbd-4df6-b61d-345cf536f0ad tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] show failed (client error): The resource could not be found. Nov 24 16:27:30.658531 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-50aa2d6a-fdbd-4df6-b61d-345cf536f0ad tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups/b02b4802-12d9-4bc3-9ea6-a0b45dbaedd3 HTTP/1.1" status: 404 len: 347 time: 0.0169764 Nov 24 16:27:30.661483 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52500) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:30.786347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Deleting port c830f907-66cc-47ae-a88c-4a8c642eb8da {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:27:30.786688 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.862549 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.862874 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:30.874700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Calling delete_port for c830f907-66cc-47ae-a88c-4a8c642eb8da owned by network:floatingip {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:27:31.061368 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.087781 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'Port': ['ID=c830f907-66cc-47ae-a88c-4a8c642eb8da,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:31.150324 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.153550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.157527 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-23764ebf-a1aa-42e2-a118-0914d1792f90 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "DELETE /v2.0/floatingips/bce43c38-c74a-41bb-a9e8-0064c3b81952 HTTP/1.1" status: 204 len: 168 time: 0.4921675 Nov 24 16:27:31.235196 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:27:31.255945 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:27:31.256377 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a2d648b5-7d8c-4e1f-930a-696fcfbe5bd5 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:27:31.451141 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52510) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:31.455838 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group': {'name': 'tempest-securitygroup--273592504', 'description': 'tempest-description--1740742708'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:31.549595 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.560904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118f2296-d730-461e-b191-17fbbcddbc9f req-a1a7f4fb-874e-44c9-978f-b07e18e11e38 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:31.562410 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-118f2296-d730-461e-b191-17fbbcddbc9f req-a1a7f4fb-874e-44c9-978f-b07e18e11e38 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0504768 Nov 24 16:27:31.615013 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-118f2296-d730-461e-b191-17fbbcddbc9f req-4d7a20ba-b68c-4707-bafe-7f97d24a6ce6 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454326 Nov 24 16:27:31.620753 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.707361 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.736001 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6ea77e8f-d594-4451-80ed-ce7f1e9da41d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:31.817817 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.819052 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-33a3cb63-b538-4bb1-8448-fb52d9e7654f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3668547 Nov 24 16:27:31.822241 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52516) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:31.826487 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group_rule': {'security_group_id': '6ea77e8f-d594-4451-80ed-ce7f1e9da41d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:31.906300 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:31.962278 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.027934 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.045696 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03812a70-e745-46ca-af83-09dc431d7717,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:32.120786 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.122038 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d209a60d-18f3-4d5e-93f0-9c8f345102c2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2988133 Nov 24 16:27:32.124585 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52518) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:32.128872 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'security_group_rule': {'security_group_id': '6ea77e8f-d594-4451-80ed-ce7f1e9da41d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:32.205562 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.258635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.320116 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.336707 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=919a3660-578b-4b4c-b98e-177374e15bfd,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:32.408063 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.409246 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-6a36e72b-42f0-4536-a4c0-e7af4664df35 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2836444 Nov 24 16:27:32.412278 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52520) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:32.416589 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:32.509309 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.607034 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.720629 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Allocated IP 172.27.2.76 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/da7a004d-04fa-48fe-bb43-bf00d557ef1b) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:32.733946 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9b821e-a7b1-4f04-9c1c-cd1ef3e990e6 req-610e86b4-187c-43a8-9c29-b3ff52770c1a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:32.735476 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a9b821e-a7b1-4f04-9c1c-cd1ef3e990e6 req-610e86b4-187c-43a8-9c29-b3ff52770c1a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0492537 Nov 24 16:27:32.783629 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3a9b821e-a7b1-4f04-9c1c-cd1ef3e990e6 req-55bab050-d1c3-45aa-af53-fdc94024a202 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419979 Nov 24 16:27:32.829764 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.924510 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:32.961388 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:32.964171 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:32.966640 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:32.989098 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=da7a004d-04fa-48fe-bb43-bf00d557ef1b,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:33.051474 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.151733 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.297433 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.352556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.420975 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=da7a004d-04fa-48fe-bb43-bf00d557ef1b,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:33.431963 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.514570 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:33.515856 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-f461a05e-651c-4db5-97ca-3028a7008106 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1026165 Nov 24 16:27:33.762174 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-e5651829-7a85-4dcb-a57e-995395d35792 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-securitygroup--273592504&fields=id&tenant_id=b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 267 time: 0.0494273 Nov 24 16:27:33.908832 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e0ebe3-752e-4a29-b84a-acbb1c4e53f4 req-a8c32e41-183b-4526-b4fd-e04be16e7b4a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:33.910447 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-80e0ebe3-752e-4a29-b84a-acbb1c4e53f4 req-a8c32e41-183b-4526-b4fd-e04be16e7b4a tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0566089 Nov 24 16:27:33.960714 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-80e0ebe3-752e-4a29-b84a-acbb1c4e53f4 req-bd587843-a525-407e-a551-717506eb04e9 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/security-groups?id=c2ae54f5-d105-4b6a-a72b-10c65427b833&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440593 Nov 24 16:27:34.077610 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-6cb6ef94-ae69-411a-a820-803882c5066d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:34.079177 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-6cb6ef94-ae69-411a-a820-803882c5066d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 810 time: 0.3105297 Nov 24 16:27:34.100490 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-835c354e-acd1-423a-8bcc-268e10993806 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/quotas/b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 375 time: 0.0114548 Nov 24 16:27:34.146591 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-8dece2e4-200b-4714-a813-9f4373d665d5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:34.148086 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-8dece2e4-200b-4714-a813-9f4373d665d5 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 946 time: 0.0492053 Nov 24 16:27:34.154008 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-a6619bb9-159c-461f-bbcc-5f60353b6ae8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0474451 Nov 24 16:27:34.246307 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Deleting port db695f6a-d904-4558-ab8e-c235cc3cc92a {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:27:34.246640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:34.292316 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-0d151b41-c0bf-4b90-9e23-dfa872052d1f service neutron] 10.222.0.82 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267600 Nov 24 16:27:34.338277 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] For port db695f6a-d904-4558-ab8e-c235cc3cc92a, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=db695f6a-d904-4558-ab8e-c235cc3cc92a,segment=NetworkSegment(05c68f21-b538-4544-a014-1cd8d8520388),segment_id=05c68f21-b538-4544-a014-1cd8d8520388)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:34.338639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:34.351527 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Calling delete_port for db695f6a-d904-4558-ab8e-c235cc3cc92a owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:27:34.384544 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-1f5f132d-ea8c-4e65-8108-84d99f7a6b38 service neutron] 10.222.0.82 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852566 Nov 24 16:27:34.627152 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:34.638618 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['db695f6a-d904-4558-ab8e-c235cc3cc92a'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:34.656523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Pushing event deleted for resources: {'Port': ['ID=db695f6a-d904-4558-ab8e-c235cc3cc92a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:34.698453 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] No DVR routers for this DVR port db695f6a-d904-4558-ab8e-c235cc3cc92a on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:27:34.703720 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:34.707759 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f0a0b566-f71f-4e3e-b116-1e8dedfb8ae6 req-ffafc73a-3f96-4804-8a71-047740e8dbd3 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.84 "DELETE /v2.0/ports/db695f6a-d904-4558-ab8e-c235cc3cc92a HTTP/1.1" status: 204 len: 173 time: 0.5507662 Nov 24 16:27:34.707929 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'name': 'network-vif-deleted', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:34.710393 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0508c288-beac-48ac-b7a5-f26e8d493ae4" -d '{"events": [{"server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "name": "network-vif-deleted", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:34.770752 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6906b8a8-379b-4b09-b713-63d8b2caa074 x-openstack-request-id: req-6906b8a8-379b-4b09-b713-63d8b2caa074 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:34.771077 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "307bacab-ab83-4822-8b12-855139bbd294", "name": "network-vif-deleted", "tag": "db695f6a-d904-4558-ab8e-c235cc3cc92a", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:34.771343 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6906b8a8-379b-4b09-b713-63d8b2caa074 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:34.771755 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '307bacab-ab83-4822-8b12-855139bbd294', 'name': 'network-vif-deleted', 'tag': 'db695f6a-d904-4558-ab8e-c235cc3cc92a', 'status': 'completed', 'code': 200} Nov 24 16:27:34.774182 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8dd8f0b6-7d97-4c4a-8c2c-930a861b3a56 req-f23aa2ab-010e-4246-a54b-a705d9cd0374 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 210 time: 0.0401945 Nov 24 16:27:35.070656 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-397eb1ff-6321-48c2-ab01-53d172383d1e req-f3b49ad2-f619-42fa-bb34-57a946994594 tempest-VolumesSnapshotTestJSON-2135977620 tempest-VolumesSnapshotTestJSON-2135977620-project] 10.222.0.82 "GET /v2.0/ports?device_id=307bacab-ab83-4822-8b12-855139bbd294 HTTP/1.1" status: 200 len: 210 time: 0.0256543 Nov 24 16:27:35.880911 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-65a8e290-731c-4ae6-8a06-9c68e63a5b9b req-a8bfb9dd-0c02-4810-a3b2-f9c5aaa9d1d0 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 210 time: 0.0274639 Nov 24 16:27:36.989545 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-76ac8e81-b5fc-4dd3-b3b3-dc0934812c3b req-f9f29cd1-a7b4-49df-bb7c-d6f844a4ffd7 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 210 time: 0.0278101 Nov 24 16:27:37.143820 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-09f2f627-39fc-4f52-832e-dc5d54ab677f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:37.145268 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-09f2f627-39fc-4f52-832e-dc5d54ab677f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 810 time: 0.1047776 Nov 24 16:27:37.212375 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-7b16ef81-400f-4a50-a309-c0f41d4f4f81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b96983a681284ac1a3cb8640a9c716cd HTTP/1.1" status: 200 len: 379 time: 0.0521801 Nov 24 16:27:37.222455 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'port': {'device_id': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'admin_state_up': True, 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'security_groups': ['6ea77e8f-d594-4451-80ed-ce7f1e9da41d']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:37.251909 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device db695f6a-d904-4558-ab8e-c235cc3cc92a no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:27:37.273547 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: db695f6a-d904-4558-ab8e-c235cc3cc92a {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:27:37.273901 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device db695f6a-d904-4558-ab8e-c235cc3cc92a not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:27:37.429189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Made reservation on behalf of b96983a681284ac1a3cb8640a9c716cd for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:27:37.432779 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:37.561848 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Allocated IP 172.20.0.9 (92d9ce23-f297-4622-a4e7-b9b5a8f48b19/aaaaeafb-6af7-4460-8050-86d8b3b3deb8/b9e21718-7745-4050-aa02-da6a0542289e) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:37.700438 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:37.789565 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:37.829797 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:37.834700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:37.838230 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:37.864291 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event updated for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:37.893465 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:37.894107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:37.986279 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ecf2d353-e37e-450f-918d-b45b4db5dd81 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7673430 Nov 24 16:27:38.101287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Request body: {'port': {'device_id': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:38.127304 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-86296c9e-2138-4681-9a18-91fe9447de49 None None] Provisioning complete for port b9e21718-7745-4050-aa02-da6a0542289e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:38.131434 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-86296c9e-2138-4681-9a18-91fe9447de49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.164026 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-86296c9e-2138-4681-9a18-91fe9447de49 None None] Port b9e21718-7745-4050-aa02-da6a0542289e cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:27:38.205387 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.215401 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1acf412-7e8f-4901-b49d-b54699fe10e2 req-3057c097-a378-4019-a666-8de39214392a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:38.216858 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1acf412-7e8f-4901-b49d-b54699fe10e2 req-3057c097-a378-4019-a666-8de39214392a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 931 time: 0.0912869 Nov 24 16:27:38.303446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b1acf412-7e8f-4901-b49d-b54699fe10e2 req-2e3de9a5-f360-4ec8-b27d-62127238e87f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800328 Nov 24 16:27:38.502558 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b9e21718-7745-4050-aa02-da6a0542289e {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:38.510113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.521509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Transition to ACTIVE for port object b9e21718-7745-4050-aa02-da6a0542289e will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:27:38.599958 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.651803 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Pushing event updated for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:38.723534 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Attempting to bind port b9e21718-7745-4050-aa02-da6a0542289e on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:27:38.723870 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Attempting to bind port b9e21718-7745-4050-aa02-da6a0542289e by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:27:38.724198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Attempting to bind port b9e21718-7745-4050-aa02-da6a0542289e on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:38.729140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Port b9e21718-7745-4050-aa02-da6a0542289e on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:27:38.729459 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Attempting to bind port b9e21718-7745-4050-aa02-da6a0542289e on network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:38.735228 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 27, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:27:38.735577 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Checking segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:27:38.735989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Bound using segment: {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:27:38.736408 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Bound port: b9e21718-7745-4050-aa02-da6a0542289e, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '069d1d08-3607-440c-b8cc-fd16cb843e41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:27:38.736773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.801107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:27:38.804059 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=b9e21718-7745-4050-aa02-da6a0542289e,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:27:38.857996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.892346 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:38.892963 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:38.894335 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] 10.222.0.84 "PUT /v2.0/ports/b9e21718-7745-4050-aa02-da6a0542289e HTTP/1.1" status: 200 len: 1093 time: 0.8787930 Nov 24 16:27:38.894768 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:38.896995 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e" -d '{"events": [{"name": "network-changed", "server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "tag": "b9e21718-7745-4050-aa02-da6a0542289e"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:38.925754 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cbe343-f3f6-4186-b7eb-acc46af7010b service neutron] Pushing event updated for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:38.995126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98614a99-872f-420f-94f2-db96b9148343 x-openstack-request-id: req-98614a99-872f-420f-94f2-db96b9148343 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:38.995126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "tag": "b9e21718-7745-4050-aa02-da6a0542289e", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:38.995302 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-98614a99-872f-420f-94f2-db96b9148343 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:38.995800 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e', 'status': 'completed', 'code': 200} Nov 24 16:27:39.648586 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f370eec4-296e-485a-a7a9-e169c7501c29 req-92f7c0bb-0250-4e59-9ad0-fcb787d179d5 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:39.650044 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f370eec4-296e-485a-a7a9-e169c7501c29 req-92f7c0bb-0250-4e59-9ad0-fcb787d179d5 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0489371 Nov 24 16:27:39.695983 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f370eec4-296e-485a-a7a9-e169c7501c29 req-ca394734-b162-40fe-b60d-4f44762ee9dd tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400343 Nov 24 16:27:40.808454 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afc0ca9-eaca-4e0f-ac1c-67e45af49c6d req-355baac3-97c3-4c06-8a0b-a828f6d92ebc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:40.809928 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8afc0ca9-eaca-4e0f-ac1c-67e45af49c6d req-355baac3-97c3-4c06-8a0b-a828f6d92ebc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0473084 Nov 24 16:27:40.861229 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8afc0ca9-eaca-4e0f-ac1c-67e45af49c6d req-e3a19d2e-6e6d-402a-9b91-a9429fc6041e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453217 Nov 24 16:27:41.738547 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-20038136-2234-4df5-ab21-01708a080521 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:41.740038 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-20038136-2234-4df5-ab21-01708a080521 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 1096 time: 0.0396535 Nov 24 16:27:41.846391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-072e0cb1-4566-4d86-b1e6-e872e78fa395 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:41.852174 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-072e0cb1-4566-4d86-b1e6-e872e78fa395 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=b96983a681284ac1a3cb8640a9c716cd&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0930395 Nov 24 16:27:41.991928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-135f33da-ed38-4edf-a3c4-d178dedad59a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:41.993392 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e404ea8b-fa19-4d63-a2ab-3253fc834f7e req-135f33da-ed38-4edf-a3c4-d178dedad59a service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1234066 Nov 24 16:27:42.002061 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c414fb7-104c-4378-a77f-6d7e12ea0419 req-bab08a6f-4ea9-4388-a417-4b1e7e1d1b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:42.003542 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c414fb7-104c-4378-a77f-6d7e12ea0419 req-bab08a6f-4ea9-4388-a417-4b1e7e1d1b25 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0717206 Nov 24 16:27:42.056879 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c414fb7-104c-4378-a77f-6d7e12ea0419 req-34fbd2fd-89ca-46b4-afe9-3c8f172f302d tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472596 Nov 24 16:27:42.100833 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-6bcf0ff6-d0ff-4a95-a85a-40802b78028c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:42.102336 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-6bcf0ff6-d0ff-4a95-a85a-40802b78028c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 1096 time: 0.0446136 Nov 24 16:27:42.146485 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-5c87214b-2bbd-455c-822c-1e034af703c2 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b9e21718-7745-4050-aa02-da6a0542289e HTTP/1.1" status: 200 len: 217 time: 0.0341580 Nov 24 16:27:42.205338 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-bfe61d32-0b8b-47a6-8ba3-a613b4bc28c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:42.206796 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-bfe61d32-0b8b-47a6-8ba3-a613b4bc28c4 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.0441394 Nov 24 16:27:42.260132 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-5a3869d7-2b37-4905-ac6d-1ee3b856c3de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:42.261604 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-5a3869d7-2b37-4905-ac6d-1ee3b856c3de service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435009 Nov 24 16:27:42.361873 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-ec20c093-825b-4907-9779-04f32c5dd137 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884037 Nov 24 16:27:42.458572 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f58b964a-b87a-4e6d-876e-35cc26f1b300 req-fbc82e1f-da0e-46ca-b7bf-7db20f904b47 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883691 Nov 24 16:27:43.181842 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d02c71-805e-4fd7-b453-786072dc2d10 req-ed8922dc-80c7-4670-9846-00afacba55fd tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:43.183395 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-48d02c71-805e-4fd7-b453-786072dc2d10 req-ed8922dc-80c7-4670-9846-00afacba55fd tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0540600 Nov 24 16:27:43.230214 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-48d02c71-805e-4fd7-b453-786072dc2d10 req-5430631e-6a47-47be-8330-116b1fa1df5a tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403302 Nov 24 16:27:43.273131 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-e11cfb77-709a-47ea-9ebc-90aa791a21ea tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:43.274601 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-e11cfb77-709a-47ea-9ebc-90aa791a21ea tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1016665 Nov 24 16:27:43.290563 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-1d033449-bca5-43c4-bc8c-b218ba5f9338 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/quotas/4e6a8ec37517478d90f3886b61b1beb6 HTTP/1.1" status: 200 len: 375 time: 0.0088987 Nov 24 16:27:43.347275 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-405fd7f5-1f35-4c9f-bffa-a67e8560ceee tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0508814 Nov 24 16:27:43.477678 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-f0a34084-7987-4d64-9813-4f07ccefb901 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236598 Nov 24 16:27:43.570487 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-eb4839ce-2002-493a-b2c7-bde3e5ea04c8 service neutron] 10.222.0.82 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862498 Nov 24 16:27:43.810956 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-06c3e185-eeb8-4055-881b-e166b50c1ac6 req-f0749604-75da-4381-bf0a-d364322ea018 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 210 time: 0.0261693 Nov 24 16:27:44.344794 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed0ea61-285e-47f3-864b-10ec82f09e41 req-fe987cb7-358f-4e38-b3bc-710ef99085d4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:44.346182 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8ed0ea61-285e-47f3-864b-10ec82f09e41 req-fe987cb7-358f-4e38-b3bc-710ef99085d4 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0501025 Nov 24 16:27:44.394029 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8ed0ea61-285e-47f3-864b-10ec82f09e41 req-2b1b4781-6ffd-4d59-8725-f1259666bb3e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418179 Nov 24 16:27:44.914412 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87ba941e-0e4c-45de-8aaa-9670f4ac9074 req-ad833744-387c-4eda-85fe-d567c586d08c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 210 time: 0.0261233 Nov 24 16:27:45.511252 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-582f54a5-ca60-4e77-a981-753d8b51fe34 req-8ee12095-04e9-4640-b37b-f21f2f7fbbae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:45.512754 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-582f54a5-ca60-4e77-a981-753d8b51fe34 req-8ee12095-04e9-4640-b37b-f21f2f7fbbae tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 943 time: 0.0513706 Nov 24 16:27:45.560899 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-582f54a5-ca60-4e77-a981-753d8b51fe34 req-1eab8b3e-7915-4667-864b-6b404403c335 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423236 Nov 24 16:27:45.614096 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device b9e21718-7745-4050-aa02-da6a0542289e details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:27:45.769521 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=b9e21718-7745-4050-aa02-da6a0542289e,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:45.783590 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'b9e21718-7745-4050-aa02-da6a0542289e', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'port_id': 'b9e21718-7745-4050-aa02-da6a0542289e', 'mac_address': 'fa:16:3e:a4:2d:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 858, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:27:45.819900 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:45.833721 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b9e21718-7745-4050-aa02-da6a0542289e {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:45.840370 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-a10b49d5-fe4f-4b27-8526-4af12dbdcc6a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:45.841842 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-a10b49d5-fe4f-4b27-8526-4af12dbdcc6a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/networks?id=24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 200 len: 814 time: 0.1064212 Nov 24 16:27:45.853052 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=b9e21718-7745-4050-aa02-da6a0542289e,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:45.865805 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Request body: {'port': {'device_id': '94159ebd-9299-4b17-a457-0a1596383b78', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'admin_state_up': True, 'tenant_id': '4e6a8ec37517478d90f3886b61b1beb6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:45.947516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:45.997498 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:46.023522 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8a02f744-edec-40a8-b42a-a71c36f444c8 req-95e738d6-c18c-41c8-9b69-38ebc590de16 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 210 time: 0.0357950 Nov 24 16:27:46.063082 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Made reservation on behalf of 4e6a8ec37517478d90f3886b61b1beb6 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:27:46.066637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.199817 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Allocated IP 172.20.0.3 (24dab433-4f5d-49db-b2f0-46e992af618f/0b71499c-2eb4-4056-877a-cc924aa6fe1f/a8852328-86fa-45d2-bff7-9c714476f4d6) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:27:46.345478 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.357196 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['b9e21718-7745-4050-aa02-da6a0542289e'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:46.447121 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.493640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Network 24dab433-4f5d-49db-b2f0-46e992af618f is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:27:46.497316 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:27:46.501117 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:27:46.507610 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event updated for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:46.554108 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:46.554731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.631691 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-5e39b30d-e906-4acf-9b7f-f0d162e4191b tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7696338 Nov 24 16:27:46.651146 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Request body: {'port': {'device_id': '94159ebd-9299-4b17-a457-0a1596383b78', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:46.673743 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89263332-8be1-4b4a-9a3a-a23bcc2f99c7 req-33c8d21a-7a11-450c-86d8-c2be07dde45b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:46.675419 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89263332-8be1-4b4a-9a3a-a23bcc2f99c7 req-33c8d21a-7a11-450c-86d8-c2be07dde45b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 944 time: 0.0485818 Nov 24 16:27:46.711671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.724915 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89263332-8be1-4b4a-9a3a-a23bcc2f99c7 req-ecb813a4-67a7-40bc-a881-b36082d3ac0b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433021 Nov 24 16:27:46.932178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6f20d40c-358f-4b5c-bc3b-36898e68d608 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.978363 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a8852328-86fa-45d2-bff7-9c714476f4d6 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:46.986320 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:46.998590 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Transition to ACTIVE for port object a8852328-86fa-45d2-bff7-9c714476f4d6 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:27:47.072937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:47.154749 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:27:47.172033 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Pushing event updated for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:47.182267 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df', '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', '4b2ba5f2-f884-41f8-902c-cb9ddc407213'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:47.219190 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0502619a-3e1c-415c-8234-af38c5a76d37 req-393fde91-d88d-4591-9cd2-e0afc9c74dfb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:47.220739 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0502619a-3e1c-415c-8234-af38c5a76d37 req-393fde91-d88d-4591-9cd2-e0afc9c74dfb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.1226606 Nov 24 16:27:47.253589 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Attempting to bind port a8852328-86fa-45d2-bff7-9c714476f4d6 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:27:47.253920 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Attempting to bind port a8852328-86fa-45d2-bff7-9c714476f4d6 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:27:47.260060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Attempting to bind port a8852328-86fa-45d2-bff7-9c714476f4d6 on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:47.264371 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Port a8852328-86fa-45d2-bff7-9c714476f4d6 on network 24dab433-4f5d-49db-b2f0-46e992af618f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:27:47.264695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Attempting to bind port a8852328-86fa-45d2-bff7-9c714476f4d6 on network 24dab433-4f5d-49db-b2f0-46e992af618f {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:27:47.277571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 27, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:27:47.277911 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Checking segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:27:47.278293 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Bound using segment: {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:27:47.278720 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Bound port: a8852328-86fa-45d2-bff7-9c714476f4d6, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f3c6a933-35bb-4586-9209-7b535731374f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:27:47.279098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:47.303652 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0502619a-3e1c-415c-8234-af38c5a76d37 req-b8a546ce-ba43-4c42-9fe7-325d94174689 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739157 Nov 24 16:27:47.358530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:27:47.361452 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a8852328-86fa-45d2-bff7-9c714476f4d6,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:27:47.427523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:47.459739 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:47.460365 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:47.461738 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] 10.222.0.84 "PUT /v2.0/ports/a8852328-86fa-45d2-bff7-9c714476f4d6 HTTP/1.1" status: 200 len: 1093 time: 0.8149209 Nov 24 16:27:47.464181 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:47.467707 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a242933b-2a24-4d84-b383-1c8414026775" -d '{"events": [{"name": "network-changed", "server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:47.495563 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4186447a-aacd-482d-94bf-6a46110ed9b3 service neutron] Pushing event updated for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:47.506205 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12627774-c39c-4806-be65-5592c4d8e0c0 x-openstack-request-id: req-12627774-c39c-4806-be65-5592c4d8e0c0 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:47.506495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:47.506752 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-12627774-c39c-4806-be65-5592c4d8e0c0 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:47.507188 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6', 'status': 'completed', 'code': 200} Nov 24 16:27:47.839275 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30af4fd-ebb9-4474-93f6-e14847f6d44f req-b1dc528a-d64c-4065-b6aa-9932453ddbfc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:47.840758 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b30af4fd-ebb9-4474-93f6-e14847f6d44f req-b1dc528a-d64c-4065-b6aa-9932453ddbfc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 944 time: 0.0472968 Nov 24 16:27:47.885635 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b30af4fd-ebb9-4474-93f6-e14847f6d44f req-2c95e39e-e08d-4b66-98a2-1b936498f5ee tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391736 Nov 24 16:27:48.420909 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd7bb3b9-b42b-4404-b56e-5cd43ca9d234 req-5fa7e10f-19a2-4809-8240-5990e2f7ee07 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:48.422426 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dd7bb3b9-b42b-4404-b56e-5cd43ca9d234 req-5fa7e10f-19a2-4809-8240-5990e2f7ee07 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.0488963 Nov 24 16:27:48.469556 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dd7bb3b9-b42b-4404-b56e-5cd43ca9d234 req-b19ad6c7-9213-4349-9868-6a7e098b0efb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411131 Nov 24 16:27:48.997786 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8bebe4e-41c3-44a9-aa3c-21977acefc75 req-9f2182f8-df2b-417e-b7d8-c48eae0f3325 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:48.999275 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a8bebe4e-41c3-44a9-aa3c-21977acefc75 req-9f2182f8-df2b-417e-b7d8-c48eae0f3325 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 944 time: 0.0477517 Nov 24 16:27:49.049069 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a8bebe4e-41c3-44a9-aa3c-21977acefc75 req-3a4411c4-328d-47e8-9032-166eb14f93b2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439775 Nov 24 16:27:49.238229 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-000e2665-83fd-4810-a8c1-1ebd5aba71b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:49.585854 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8facec41-ed6d-4335-bc1e-7cf586a15b0e req-3fd3e1d5-81b8-4680-bbdb-a0cd79de316d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:49.587380 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8facec41-ed6d-4335-bc1e-7cf586a15b0e req-3fd3e1d5-81b8-4680-bbdb-a0cd79de316d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.0499978 Nov 24 16:27:49.634111 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8facec41-ed6d-4335-bc1e-7cf586a15b0e req-bf2bc68f-5e59-4840-8bd1-2aff8b380e29 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402348 Nov 24 16:27:50.170600 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aeac8f1-5f18-44d0-b12f-d5dd5fc0cbaf req-f2e3b421-6040-4869-83a6-32b93af96aab tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:50.172539 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9aeac8f1-5f18-44d0-b12f-d5dd5fc0cbaf req-f2e3b421-6040-4869-83a6-32b93af96aab tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 944 time: 0.0552909 Nov 24 16:27:50.220519 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9aeac8f1-5f18-44d0-b12f-d5dd5fc0cbaf req-24f2eaa1-0a3a-44ab-9b49-a3043b558cea tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420618 Nov 24 16:27:50.360151 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:50.553013 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device b9e21718-7745-4050-aa02-da6a0542289e up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:50.603188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a242933b-2a24-4d84-b383-1c8414026775 req-d0cca457-f9b7-46f8-be92-ad4d553cf08a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:50.604731 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a242933b-2a24-4d84-b383-1c8414026775 req-d0cca457-f9b7-46f8-be92-ad4d553cf08a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 1096 time: 0.0441077 Nov 24 16:27:50.660854 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port b9e21718-7745-4050-aa02-da6a0542289e completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:50.664989 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port b9e21718-7745-4050-aa02-da6a0542289e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:50.665421 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:50.720742 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a242933b-2a24-4d84-b383-1c8414026775 req-b55b8c0d-d15f-4812-8770-f3744c45e916 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:50.722174 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a242933b-2a24-4d84-b383-1c8414026775 req-b55b8c0d-d15f-4812-8770-f3744c45e916 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1033995 Nov 24 16:27:50.745064 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:50.768489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:50.771511 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-baddf372-189e-4940-9f62-e1684bf0a6f8" -d '{"events": [{"server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "name": "network-vif-plugged", "status": "completed", "tag": "b9e21718-7745-4050-aa02-da6a0542289e"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:50.787490 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=b9e21718-7745-4050-aa02-da6a0542289e,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:50.811892 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3728fc4a-1d5a-4918-8520-3a117c815d2d req-c4cacb48-30d7-425d-98e3-98f0087a1b6f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:50.813387 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3728fc4a-1d5a-4918-8520-3a117c815d2d req-c4cacb48-30d7-425d-98e3-98f0087a1b6f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.1102796 Nov 24 16:27:50.813680 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c4a92a1-d2fe-4cde-b52c-bac76d230388 x-openstack-request-id: req-4c4a92a1-d2fe-4cde-b52c-bac76d230388 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:50.814376 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "name": "network-vif-plugged", "status": "completed", "tag": "b9e21718-7745-4050-aa02-da6a0542289e", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:50.814648 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-4c4a92a1-d2fe-4cde-b52c-bac76d230388 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:50.815084 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e', 'code': 200} Nov 24 16:27:50.867616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a242933b-2a24-4d84-b383-1c8414026775 req-8999cca6-a8b3-40c7-a835-2e535661c4bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:50.869071 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a242933b-2a24-4d84-b383-1c8414026775 req-8999cca6-a8b3-40c7-a835-2e535661c4bd service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1304243 Nov 24 16:27:50.874677 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:50.881111 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3728fc4a-1d5a-4918-8520-3a117c815d2d req-bcbd24e7-cb4a-4586-b715-6fb803d08812 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610328 Nov 24 16:27:50.931446 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:51.234878 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-cac15bff-f663-423e-bba6-3068a26388e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:51.236353 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-cac15bff-f663-423e-bba6-3068a26388e6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 1096 time: 0.3125169 Nov 24 16:27:51.298046 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-e7745598-f034-4b9a-b61c-2f23a16432a3 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8852328-86fa-45d2-bff7-9c714476f4d6 HTTP/1.1" status: 200 len: 217 time: 0.0378218 Nov 24 16:27:51.308500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b9e6c2-638f-475e-bad1-e58fa94f4eaf req-8751243b-c3ba-48c2-bd57-52f1de9d05c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:51.310448 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14b9e6c2-638f-475e-bad1-e58fa94f4eaf req-8751243b-c3ba-48c2-bd57-52f1de9d05c1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 1098 time: 0.0781286 Nov 24 16:27:51.342291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32fc9c7-023e-42e2-b0ec-e14d67565d94 req-b2f3928e-6e13-4456-9943-97ad863f2fd8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:51.344286 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b32fc9c7-023e-42e2-b0ec-e14d67565d94 req-b2f3928e-6e13-4456-9943-97ad863f2fd8 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0535545 Nov 24 16:27:51.376013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e0d233-6769-4339-845f-78889aef845d req-29fcbf05-abae-487e-b1e3-70733c8e34f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:51.377515 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-29fcbf05-abae-487e-b1e3-70733c8e34f8 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 200 len: 854 time: 0.0714474 Nov 24 16:27:51.394107 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b32fc9c7-023e-42e2-b0ec-e14d67565d94 req-5e3f214e-9085-4f4f-8f47-8323cfa16a6f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435500 Nov 24 16:27:51.400565 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-14b9e6c2-638f-475e-bad1-e58fa94f4eaf req-fa3d49f2-7768-493e-a4c2-a0335eb979f4 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0653486 Nov 24 16:27:51.414576 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-8e64d3b4-e101-4d20-9e7f-9e23b9ba8331 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=24dab433-4f5d-49db-b2f0-46e992af618f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263417 Nov 24 16:27:51.741136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:51.779272 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-d7934a84-dd7b-4eeb-865c-aba0da06d2d9 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863574 Nov 24 16:27:51.878182 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-23e0d233-6769-4339-845f-78889aef845d req-49419644-2a32-465d-a520-630b6570d152 service neutron] 10.222.0.84 "GET /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867734 Nov 24 16:27:51.997867 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c32d3a2-e3c0-4453-8234-200644e32d6c req-aa8bbaba-6e34-447d-8c73-f01fb788af1a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:51.999272 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3c32d3a2-e3c0-4453-8234-200644e32d6c req-aa8bbaba-6e34-447d-8c73-f01fb788af1a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.0480781 Nov 24 16:27:52.044937 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3c32d3a2-e3c0-4453-8234-200644e32d6c req-b802818b-1734-4f92-86df-44be727c94a6 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397184 Nov 24 16:27:52.428519 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:52.515284 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d90958-da1a-4569-a21e-16c7a1c99827 req-0f1fb6bc-2eba-4a24-b43d-9f8629345560 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:52.516943 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-01d90958-da1a-4569-a21e-16c7a1c99827 req-0f1fb6bc-2eba-4a24-b43d-9f8629345560 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0512598 Nov 24 16:27:52.564611 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-01d90958-da1a-4569-a21e-16c7a1c99827 req-2fa99053-266d-42fa-a2da-8f4a946ab6c3 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418727 Nov 24 16:27:53.170660 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd73ed8-380c-42d8-b7f0-31d0c45341c2 req-cc968f3e-3794-4247-9278-d9de65545869 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:53.172150 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbd73ed8-380c-42d8-b7f0-31d0c45341c2 req-cc968f3e-3794-4247-9278-d9de65545869 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.0525620 Nov 24 16:27:53.219307 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cbd73ed8-380c-42d8-b7f0-31d0c45341c2 req-5ffee791-918b-4c01-9dc6-1d60a66840a2 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410709 Nov 24 16:27:53.682793 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b843fe-83ed-4e48-93ab-1df3b9a2b1ae req-eb68cf33-4aff-4e3d-a894-87de34a71859 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:53.685170 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8b843fe-83ed-4e48-93ab-1df3b9a2b1ae req-eb68cf33-4aff-4e3d-a894-87de34a71859 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0513327 Nov 24 16:27:53.735592 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8b843fe-83ed-4e48-93ab-1df3b9a2b1ae req-9afc6e7a-2932-4c62-b352-e3f23f63e52b tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449030 Nov 24 16:27:53.846065 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e97cf1b-b7e6-49e3-84f6-e2c3415e8baa req-a7b83631-00a2-455b-8f24-64b74038d5f2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:53.847535 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3e97cf1b-b7e6-49e3-84f6-e2c3415e8baa req-a7b83631-00a2-455b-8f24-64b74038d5f2 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0484471 Nov 24 16:27:53.856855 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52798) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:27:53.864258 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Request body: {'floatingip': {'port_id': 'b9e21718-7745-4050-aa02-da6a0542289e'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:27:53.906654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.393236 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39fecb49-4b36-45fc-a8dc-a7576126644d req-873bbed4-4690-4f96-b71d-b5665d617e4f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:54.394628 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-39fecb49-4b36-45fc-a8dc-a7576126644d req-873bbed4-4690-4f96-b71d-b5665d617e4f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 943 time: 0.1028485 Nov 24 16:27:54.396535 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.441799 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-39fecb49-4b36-45fc-a8dc-a7576126644d req-4668edd2-36fe-4939-be26-be2589154539 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411723 Nov 24 16:27:54.455149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.542603 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a8852328-86fa-45d2-bff7-9c714476f4d6 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:27:54.555748 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Floating IP e02968bf-bd62-4956-9f9a-49480333e5a3 associated. External IP: 172.27.2.76, port: b9e21718-7745-4050-aa02-da6a0542289e. Nov 24 16:27:54.638811 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a8852328-86fa-45d2-bff7-9c714476f4d6,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:54.649855 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'a8852328-86fa-45d2-bff7-9c714476f4d6', 'network_id': '24dab433-4f5d-49db-b2f0-46e992af618f', 'port_id': 'a8852328-86fa-45d2-bff7-9c714476f4d6', 'mac_address': 'fa:16:3e:7d:29:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 873, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0b71499c-2eb4-4056-877a-cc924aa6fe1f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:27:54.687326 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.699960 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a8852328-86fa-45d2-bff7-9c714476f4d6 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:27:54.719560 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a8852328-86fa-45d2-bff7-9c714476f4d6,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:54.765924 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.768100 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:27:54.812667 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:54.873323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:27:54.878182 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:54.882861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb81ec97-0025-4411-b053-384733608678 None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:27:54.897084 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:54.897707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:54.907399 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8911fac6-5c55-43c4-9b7b-c85960dbe356 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "PUT /v2.0/floatingips/e02968bf-bd62-4956-9f9a-49480333e5a3 HTTP/1.1" status: 200 len: 990 time: 1.0493665 Nov 24 16:27:54.907892 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:54.910178 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8128eb05-c48c-47b2-88c8-b84fbde419d5" -d '{"events": [{"name": "network-changed", "server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "tag": "b9e21718-7745-4050-aa02-da6a0542289e"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:54.946534 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9fbc708-98c1-4b94-b194-6e0245b2d038 x-openstack-request-id: req-a9fbc708-98c1-4b94-b194-6e0245b2d038 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:54.946823 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "tag": "b9e21718-7745-4050-aa02-da6a0542289e", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:54.947113 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-a9fbc708-98c1-4b94-b194-6e0245b2d038 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:54.947514 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e', 'status': 'completed', 'code': 200} Nov 24 16:27:55.006620 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:55.031117 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-7b4dcc75-29fd-4631-8899-d6ed17892b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:55.032767 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-7b4dcc75-29fd-4631-8899-d6ed17892b94 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b96983a681284ac1a3cb8640a9c716cd&device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 1098 time: 0.0457778 Nov 24 16:27:55.131369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-b640bec2-cee0-4571-8595-1eb24a512ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:55.132856 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-b640bec2-cee0-4571-8595-1eb24a512ecf service neutron] 10.222.0.84 "GET /v2.0/networks?id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 200 len: 911 time: 0.0892446 Nov 24 16:27:55.210769 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-7215ff52-30e0-4811-99eb-451e13220f8d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b9e21718-7745-4050-aa02-da6a0542289e HTTP/1.1" status: 200 len: 998 time: 0.0620191 Nov 24 16:27:55.225936 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['a8852328-86fa-45d2-bff7-9c714476f4d6'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:27:55.267129 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-42f0a6e6-56cb-4e84-8135-a649029e45ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:55.268635 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-42f0a6e6-56cb-4e84-8135-a649029e45ad service neutron] 10.222.0.84 "GET /v2.0/subnets?id=aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 200 len: 849 time: 0.0441113 Nov 24 16:27:55.277266 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e02968bf-bd62-4956-9f9a-49480333e5a3', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.76', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'b9e21718-7745-4050-aa02-da6a0542289e', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:a4:2d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:33Z', 'updated_at': '2021-11-24T16:27:54Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:55.321667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-faa46b3a-885f-49c2-8803-bd5d3e105697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:55.323848 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-faa46b3a-885f-49c2-8803-bd5d3e105697 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=92d9ce23-f297-4622-a4e7-b9b5a8f48b19&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433965 Nov 24 16:27:55.427113 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-60f5f041-81bc-46bf-b972-93f6f9b62fa0 service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912683 Nov 24 16:27:55.430429 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb81ec97-0025-4411-b053-384733608678 None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:27:55.451350 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:27:55.451971 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:55.531586 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8128eb05-c48c-47b2-88c8-b84fbde419d5 req-0313f446-c9ec-4fe7-8887-54ace30fee6b service neutron] 10.222.0.84 "GET /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939820 Nov 24 16:27:55.576486 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b7ba1c-af18-441a-adc1-6914e155fad3 req-5d7f2668-17ef-43be-b795-1002ec298a82 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:55.578646 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68b7ba1c-af18-441a-adc1-6914e155fad3 req-5d7f2668-17ef-43be-b795-1002ec298a82 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 944 time: 0.0555096 Nov 24 16:27:55.603473 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:27:55.629239 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-68b7ba1c-af18-441a-adc1-6914e155fad3 req-237d46d3-aa41-41b1-9c8c-323ee06601c5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433929 Nov 24 16:27:55.843200 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bb81ec97-0025-4411-b053-384733608678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e02968bf-bd62-4956-9f9a-49480333e5a3', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.76', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'b9e21718-7745-4050-aa02-da6a0542289e', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:a4:2d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:33Z', 'updated_at': '2021-11-24T16:27:54Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:27:55.868592 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb81ec97-0025-4411-b053-384733608678 None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e02968bf-bd62-4956-9f9a-49480333e5a3', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'floating_ip_address': '172.27.2.76', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'port_id': 'b9e21718-7745-4050-aa02-da6a0542289e', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'mac_address': 'fa:16:3e:a4:2d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:27:33Z', 'updated_at': '2021-11-24T16:27:54Z', 'revision_number': 1, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:27:56.062887 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f2cbc4-7c25-4269-83e0-4d512cb7b2f0 None None] New status for floating IP e02968bf-bd62-4956-9f9a-49480333e5a3: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:27:56.747652 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e37b33-849f-4776-9a07-c9cbc6d75f17 req-ec620572-bb20-4f4e-b918-aa69cfa36e36 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:56.749187 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-57e37b33-849f-4776-9a07-c9cbc6d75f17 req-ec620572-bb20-4f4e-b918-aa69cfa36e36 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 944 time: 0.0501487 Nov 24 16:27:56.799618 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-57e37b33-849f-4776-9a07-c9cbc6d75f17 req-6f1a1737-b246-4623-84b3-aa1d2167a938 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402584 Nov 24 16:27:57.921802 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ed00c1-4ae5-4ef3-a7a6-42cc0162c765 req-f268c62b-5a6e-4b75-b497-ad75de3a4f01 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:57.923284 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-45ed00c1-4ae5-4ef3-a7a6-42cc0162c765 req-f268c62b-5a6e-4b75-b497-ad75de3a4f01 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 944 time: 0.0473888 Nov 24 16:27:57.975834 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-45ed00c1-4ae5-4ef3-a7a6-42cc0162c765 req-27293877-bacd-4e55-8266-9a07bb49473f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464973 Nov 24 16:27:58.547261 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a8852328-86fa-45d2-bff7-9c714476f4d6 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:27:58.662704 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port a8852328-86fa-45d2-bff7-9c714476f4d6 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:27:58.666493 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port a8852328-86fa-45d2-bff7-9c714476f4d6 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:27:58.666866 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:58.741799 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:58.763749 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:27:58.765972 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4ab6be3-f792-4d80-b5ce-648a3728a576" -d '{"events": [{"server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "name": "network-vif-plugged", "status": "completed", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:27:58.778858 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a8852328-86fa-45d2-bff7-9c714476f4d6,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:27:58.857056 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:58.863204 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:27:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36da1fae-825d-42bb-8b82-f6b22f42151e x-openstack-request-id: req-36da1fae-825d-42bb-8b82-f6b22f42151e {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:27:58.866622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "name": "network-vif-plugged", "status": "completed", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:27:58.866622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-36da1fae-825d-42bb-8b82-f6b22f42151e {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:27:58.866622 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6', 'code': 200} Nov 24 16:27:58.909989 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:27:58.917338 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.917656 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.918006 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.918346 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.918695 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.919090 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.919428 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.919761 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.920116 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.920438 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.920837 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:58.921174 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:27:59.026408 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:27:59.111147 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6199c4f-2483-4503-aeca-d209a37472e8 req-5ff9024f-62b8-4535-a729-54ffee9cd862 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:59.117706 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6199c4f-2483-4503-aeca-d209a37472e8 req-5ff9024f-62b8-4535-a729-54ffee9cd862 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0646863 Nov 24 16:27:59.161314 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c6199c4f-2483-4503-aeca-d209a37472e8 req-7b899b91-1a17-4f23-803a-8c69ad75a8d9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426228 Nov 24 16:27:59.191722 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2537612-68d5-4cac-9a7e-61e6c9b11eca req-a4e8607a-39d2-4a06-87e1-c24aaa5a6ee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:27:59.193293 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b2537612-68d5-4cac-9a7e-61e6c9b11eca req-a4e8607a-39d2-4a06-87e1-c24aaa5a6ee1 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 1098 time: 0.0601244 Nov 24 16:27:59.261387 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b2537612-68d5-4cac-9a7e-61e6c9b11eca req-d73cfec3-0bb0-4d25-8713-0cbc470003d6 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389841 Nov 24 16:28:00.281183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86170f4f-cf2b-4596-b76f-605ddd7a822f req-51249843-bf6b-4e8a-9fbd-1f6cced5ed54 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:00.282555 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-86170f4f-cf2b-4596-b76f-605ddd7a822f req-51249843-bf6b-4e8a-9fbd-1f6cced5ed54 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0518365 Nov 24 16:28:00.328646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-86170f4f-cf2b-4596-b76f-605ddd7a822f req-059315d7-aea9-4dc7-a99a-ff0e317169dd tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403712 Nov 24 16:28:01.444531 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b89e5d1-e4f5-4d15-afea-91ad4191e18c req-7a90ad44-73a0-40ec-a7c0-5e55e2626fcb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:01.446229 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3b89e5d1-e4f5-4d15-afea-91ad4191e18c req-7a90ad44-73a0-40ec-a7c0-5e55e2626fcb tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0469992 Nov 24 16:28:01.491595 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3b89e5d1-e4f5-4d15-afea-91ad4191e18c req-319b4405-1f98-4e80-8469-abaee8a3ece4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390134 Nov 24 16:28:01.608896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52908) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:01.652780 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Deleting subnet 6aa9b822-d992-4b52-b747-b04d55bff714 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:01.655757 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:01.690663 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:01.728364 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:01.834845 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:01.863263 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6aa9b822-d992-4b52-b747-b04d55bff714,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:01.865445 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:01.870239 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-09d6f768-3a8f-44ae-9400-6f4f387b9d88 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/6aa9b822-d992-4b52-b747-b04d55bff714 HTTP/1.1" status: 204 len: 168 time: 0.2602327 Nov 24 16:28:01.873183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52914) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:01.946478 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.029081 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.048919 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['796ec630-98f3-43e7-992a-da71da73d27a']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:02.058546 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '05c68f21-b538-4544-a014-1cd8d8520388') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:02.058846 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '05c68f21-b538-4544-a014-1cd8d8520388') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:02.069221 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.082792 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.088979 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Releasing vlan 856 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:02.089362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:02.091638 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:02.243867 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.249348 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.252927 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] 10.222.0.82 "DELETE /v2.0/networks/796ec630-98f3-43e7-992a-da71da73d27a HTTP/1.1" status: 204 len: 168 time: 0.3786552 Nov 24 16:28:02.264181 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c53ac4-13d7-44dd-83e5-e7ee86ee65b7 admin admin] Pushing event deleted for resources: {'Network': ['ID=796ec630-98f3-43e7-992a-da71da73d27a,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:02.558214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52924) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:02.598237 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-aee73996-ea17-425b-8777-145f01af33aa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=321dd686a448414493dd3fa5f4429d91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0378964 Nov 24 16:28:02.599893 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52926) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:02.645784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.666520 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.768980 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.771629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:02.772777 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/c2ae54f5-d105-4b6a-a72b-10c65427b833 HTTP/1.1" status: 204 len: 168 time: 0.1720028 Nov 24 16:28:02.782102 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bce220-a868-4f0a-9943-a7941409fcf0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2ae54f5-d105-4b6a-a72b-10c65427b833,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:07.883594 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-3521b330-944a-44b0-a02c-86493ba1ff08 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1307067382&fields=id&tenant_id=4562b21a9bec4777b36baec6291778f5 HTTP/1.1" status: 200 len: 267 time: 0.0430019 Nov 24 16:28:07.939104 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-457fe7d1-8e5f-4327-a2cb-82e97a8b6224 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:07.940610 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-457fe7d1-8e5f-4327-a2cb-82e97a8b6224 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 985 time: 0.0518069 Nov 24 16:28:07.951445 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Request body: {'port': {'security_groups': ['77b48aa8-a04d-471f-b619-b41c1aec3a12']}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:28:08.018793 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.226971 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:08.255384 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.319581 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.336404 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:08.363272 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:08.364097 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for port, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.365505 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1048f86a-cf58-469c-b0aa-e73b3d889349 req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "PUT /v2.0/ports/4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 943 time: 0.4185328 Nov 24 16:28:08.366027 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:08.368709 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e3d1d48-27ef-4c90-b890-16eac619c07d" -d '{"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:08.371928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 52978) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:08.393604 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event updated for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=7']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:08.401584 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.401960 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.402307 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.402655 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.403130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.403349 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.403687 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.404023 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.404356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.405145 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.405286 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.405543 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4de0f83-5161-49d3-ad12-de682a3d7b4f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:08.493523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.522312 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.553819 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:08.647632 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-591c4d1f-dec8-4022-87eb-e23ad2deca3a None None] Provisioning complete for port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:28:08.648014 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-591c4d1f-dec8-4022-87eb-e23ad2deca3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.668383 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.671959 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.674313 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "DELETE /v2.0/security-groups/81430262-9c5c-4867-b9c2-ff9fd333721e HTTP/1.1" status: 204 len: 168 time: 0.2965457 Nov 24 16:28:08.677376 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 52986) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:08.685037 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f658e17c-8f58-44d7-b1a9-34855188d2ab tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=81430262-9c5c-4867-b9c2-ff9fd333721e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:08.686986 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e508260d-4292-4b34-8c5a-dfcdb0d5155b x-openstack-request-id: req-e508260d-4292-4b34-8c5a-dfcdb0d5155b {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:08.687280 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:08.687536 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e508260d-4292-4b34-8c5a-dfcdb0d5155b {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:08.687979 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:28:08.772007 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-2b54716c-6be2-4cf7-8180-b6092a4630b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:08.773522 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-2b54716c-6be2-4cf7-8180-b6092a4630b6 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1099 time: 0.0550044 Nov 24 16:28:08.847040 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Deleting port 7ea07c0b-36db-4d9a-9fca-0df4174b22fd {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:08.847369 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.875683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-5aa617ce-21ef-4f39-b9bb-fc5286d390c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:08.877202 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-5aa617ce-21ef-4f39-b9bb-fc5286d390c1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 916 time: 0.0897379 Nov 24 16:28:08.923759 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.924366 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:08.935650 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Calling delete_port for 7ea07c0b-36db-4d9a-9fca-0df4174b22fd owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:08.951275 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-745ce315-ddfb-42bf-b354-2f867d290590 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 1002 time: 0.0602534 Nov 24 16:28:09.021071 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-4a0ab2a1-f324-4b58-ab1d-58964f45f04d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:09.022558 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-4a0ab2a1-f324-4b58-ab1d-58964f45f04d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.0458784 Nov 24 16:28:09.070372 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-c9a06cd2-0756-469b-91e5-34a3eb710522 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:09.072465 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-c9a06cd2-0756-469b-91e5-34a3eb710522 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407093 Nov 24 16:28:09.173900 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-55aef56b-fd29-4b5a-8b57-1a58d9e74745 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914145 Nov 24 16:28:09.177270 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:09.202878 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event deleted for resources: {'Port': ['ID=7ea07c0b-36db-4d9a-9fca-0df4174b22fd,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:09.265170 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:09.265469 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Floating IP e3fe0d79-7872-4fc7-bddc-ad794246e0c7 disassociated (deleted). External IP: 172.27.2.192, port: 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd. Nov 24 16:28:09.281602 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e3d1d48-27ef-4c90-b890-16eac619c07d req-e4b395c2-ca41-4ff3-8438-1a8140bfff0c service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872319 Nov 24 16:28:09.467003 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Router 05159c2b-a330-441e-ab5d-008b311018b8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:28:09.571208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:28:09.575685 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:09.583043 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Sync routers for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:28:09.594155 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:09.594757 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:09.605045 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-54c59d3f-bad3-4589-b5a7-aec4531ec488 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "DELETE /v2.0/floatingips/e3fe0d79-7872-4fc7-bddc-ad794246e0c7 HTTP/1.1" status: 204 len: 168 time: 0.9265583 Nov 24 16:28:09.706409 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:09.905814 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:09.935881 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Checking router: 05159c2b-a330-441e-ab5d-008b311018b8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:28:09.944353 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:09.944983 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:27:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:10.051397 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:10.254044 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:10.280358 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2a469f1-8735-41ef-ac8c-fbd8b2b60704 None None] The sync data for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi is: [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:24:31Z', 'revision_number': 4, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522', 'name': '', 'network_id': '3244fb11-f411-4a53-b3cf-8285d8f01d99', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'mac_address': 'fa:16:3e:25:60:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_interface', 'standard_attr_id': 386, 'fixed_ips': [{'subnet_id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:30Z', 'updated_at': '2021-11-24T16:24:36Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'subnets': [{'id': '32dfcce0-5f9f-4b5c-b446-29700080ce52', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:28:10.497037 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5194fb6-c255-4c55-a169-9fd7da7084c4 None None] New status for floating IP e3fe0d79-7872-4fc7-bddc-ad794246e0c7: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:28:10.689168 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:10.691531 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d" -d '{"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:10.727024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-275131b7-7a29-4c6a-8cfb-11f2f0a4a3fd x-openstack-request-id: req-275131b7-7a29-4c6a-8cfb-11f2f0a4a3fd {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:10.727317 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:10.727598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-275131b7-7a29-4c6a-8cfb-11f2f0a4a3fd {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:10.728021 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:28:10.795457 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-5cf6782e-0755-425a-8daa-6a6e216598bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:10.797016 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-5cf6782e-0755-425a-8daa-6a6e216598bb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=4562b21a9bec4777b36baec6291778f5&device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 1099 time: 0.0426240 Nov 24 16:28:10.895421 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-92fa19c6-d5c7-4447-8e3e-c0a4b0155b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:10.896886 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-92fa19c6-d5c7-4447-8e3e-c0a4b0155b3a service neutron] 10.222.0.84 "GET /v2.0/networks?id=3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 200 len: 916 time: 0.0854230 Nov 24 16:28:10.958331 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-d84482ac-f4ba-4383-bb5a-35ee7c3313c0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 200 len: 217 time: 0.0377605 Nov 24 16:28:11.020441 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-acb56fbe-6ca2-424a-920e-e9fa66a1c844 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:11.021896 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-acb56fbe-6ca2-424a-920e-e9fa66a1c844 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 200 len: 854 time: 0.0449388 Nov 24 16:28:11.071058 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-34c7d0af-e4cc-4031-a669-c1f60970dd39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:11.072502 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-34c7d0af-e4cc-4031-a669-c1f60970dd39 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=3244fb11-f411-4a53-b3cf-8285d8f01d99&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388529 Nov 24 16:28:11.176301 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-0cacc21d-ed04-453e-8961-98c5a635429b service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885336 Nov 24 16:28:11.276943 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5ee35a9-6efa-4f58-adf3-b4ce0acada9d req-c1171eeb-e27b-41c8-8d3a-c16d7cf2c860 service neutron] 10.222.0.84 "GET /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830333 Nov 24 16:28:14.928453 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eebe388-825e-4b38-8eac-2e4d299c2ed5 req-1c000783-28fd-4065-92dd-233ff199c5a5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:14.929905 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8eebe388-825e-4b38-8eac-2e4d299c2ed5 req-1c000783-28fd-4065-92dd-233ff199c5a5 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0471768 Nov 24 16:28:14.976354 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8eebe388-825e-4b38-8eac-2e4d299c2ed5 req-83416f27-1567-4f4c-8c09-e774d048279d tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404568 Nov 24 16:28:16.095462 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9541a8d9-9479-4023-ba89-9ccee98b043e req-9d561d15-41b8-46eb-a282-473a3d07a839 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:16.096951 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9541a8d9-9479-4023-ba89-9ccee98b043e req-9d561d15-41b8-46eb-a282-473a3d07a839 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0526147 Nov 24 16:28:16.145394 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9541a8d9-9479-4023-ba89-9ccee98b043e req-63e2f6cd-58a0-41b1-8216-5a34460abe0a tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421867 Nov 24 16:28:16.552542 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a016636f-676f-4dcf-acd1-4c675e0a58bc req-5b99b09b-2c77-4d6f-8617-3f81d4442e47 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:16.554043 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a016636f-676f-4dcf-acd1-4c675e0a58bc req-5b99b09b-2c77-4d6f-8617-3f81d4442e47 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0478663 Nov 24 16:28:16.600867 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a016636f-676f-4dcf-acd1-4c675e0a58bc req-6e52d2c2-1151-4c35-ac2d-462c9f3afdde tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409451 Nov 24 16:28:16.911378 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6f5fc6bc-de8e-471d-9028-789baecddb62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:17.261479 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64713036-c808-4303-9285-9e482902ce57 req-60a17dac-93b7-42e4-aca0-0c9fda928097 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:17.263013 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-64713036-c808-4303-9285-9e482902ce57 req-60a17dac-93b7-42e4-aca0-0c9fda928097 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0479805 Nov 24 16:28:17.309257 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-64713036-c808-4303-9285-9e482902ce57 req-c62b6a7a-08fa-4be9-8d86-2cec53a8a1d4 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/security-groups?id=77b48aa8-a04d-471f-b619-b41c1aec3a12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399103 Nov 24 16:28:17.564105 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-8e3f1920-a2ff-46e4-9270-4e8c87c54ea8 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:17.565551 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-8e3f1920-a2ff-46e4-9270-4e8c87c54ea8 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.84 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 946 time: 0.0505633 Nov 24 16:28:17.668892 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Deleting port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:17.669230 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:17.721809 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d90210f-2ac5-4a6e-9abb-ec79984eda86 req-e53888a7-6612-4f0a-8775-644e5745c5b7 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:17.723328 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d90210f-2ac5-4a6e-9abb-ec79984eda86 req-e53888a7-6612-4f0a-8775-644e5745c5b7 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0544364 Nov 24 16:28:17.765170 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] For port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:17.765537 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:17.768828 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d90210f-2ac5-4a6e-9abb-ec79984eda86 req-3f6bc6fa-5cc6-4d88-b8a9-3515818296f8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395749 Nov 24 16:28:17.777708 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Calling delete_port for 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:18.257083 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:18.269761 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:18.289988 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Pushing event deleted for resources: {'Port': ['ID=4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:18.335090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] No DVR routers for this DVR port 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:18.338656 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:18.342598 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efe38b41-c84e-4728-9b7d-33329818e7f2 req-a286b7d0-8b57-43b9-8672-59ae2a680a9f tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.84 "DELETE /v2.0/ports/4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd HTTP/1.1" status: 204 len: 173 time: 0.7585909 Nov 24 16:28:18.343090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'name': 'network-vif-deleted', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:18.345381 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4062c22a-1e56-4d7a-b9f3-2dcc3bf0874f" -d '{"events": [{"server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "name": "network-vif-deleted", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:18.382028 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b1eecc4-3419-464b-bd28-b9b38cc97cb6 x-openstack-request-id: req-5b1eecc4-3419-464b-bd28-b9b38cc97cb6 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:18.382329 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67c2c403-aad1-40e3-87b2-67635f22dddd", "name": "network-vif-deleted", "tag": "4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:18.382585 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-5b1eecc4-3419-464b-bd28-b9b38cc97cb6 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:18.383019 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67c2c403-aad1-40e3-87b2-67635f22dddd', 'name': 'network-vif-deleted', 'tag': '4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd', 'status': 'completed', 'code': 200} Nov 24 16:28:18.410710 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f24482c3-31d2-4c62-9dcc-7e9fc1c7280b req-8114f138-436b-421c-817a-efdac9eec910 tempest-TestMinimumBasicScenario-527376056 tempest-TestMinimumBasicScenario-527376056-project] 10.222.0.82 "GET /v2.0/ports?device_id=67c2c403-aad1-40e3-87b2-67635f22dddd HTTP/1.1" status: 200 len: 210 time: 0.0261772 Nov 24 16:28:18.766695 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-8ec559be-6195-4a3f-ac04-bac6dbdd2672 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:18.768334 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-8ec559be-6195-4a3f-ac04-bac6dbdd2672 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0497994 Nov 24 16:28:18.866184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Deleting port a8852328-86fa-45d2-bff7-9c714476f4d6 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:18.866790 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:18.883532 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d6f1e48-555e-4f5f-b613-dd1fae4f0adb req-7bd22a48-c65c-47be-b599-a6d661f44946 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:18.884948 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2d6f1e48-555e-4f5f-b613-dd1fae4f0adb req-7bd22a48-c65c-47be-b599-a6d661f44946 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 945 time: 0.0475459 Nov 24 16:28:18.932011 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2d6f1e48-555e-4f5f-b613-dd1fae4f0adb req-a5a11115-5368-4975-aeea-5b544879935c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407581 Nov 24 16:28:18.954730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] For port a8852328-86fa-45d2-bff7-9c714476f4d6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a8852328-86fa-45d2-bff7-9c714476f4d6,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:18.955136 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:18.967917 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Calling delete_port for a8852328-86fa-45d2-bff7-9c714476f4d6 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:19.163403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:19.175268 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df', '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'a8852328-86fa-45d2-bff7-9c714476f4d6'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:19.192894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event deleted for resources: {'Port': ['ID=a8852328-86fa-45d2-bff7-9c714476f4d6,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:19.238602 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] No DVR routers for this DVR port a8852328-86fa-45d2-bff7-9c714476f4d6 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:19.241229 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:19.245458 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-61ff4ca5-2cae-4481-8e6e-05ce57d05055 req-a69fa05a-c394-4dd0-ba9f-22c771d2d960 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "DELETE /v2.0/ports/a8852328-86fa-45d2-bff7-9c714476f4d6 HTTP/1.1" status: 204 len: 173 time: 0.4675462 Nov 24 16:28:19.276221 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6af151f4-f1b5-42a3-ab4a-f8ad6286ab9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:20.042775 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bc69b938-3dea-40a6-9d1f-06faa4c6480e req-badbd65e-a2ff-454d-a2ea-e369a8736407 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=94159ebd-9299-4b17-a457-0a1596383b78 HTTP/1.1" status: 200 len: 210 time: 0.0259483 Nov 24 16:28:20.352138 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:20.383798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'name': 'network-vif-deleted', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:20.386317 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f005956-4283-4425-872c-f5da7df6e57d" -d '{"events": [{"server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "name": "network-vif-deleted", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:20.425474 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a3886d0-5c97-4a48-ab4b-41b93cc25658 x-openstack-request-id: req-8a3886d0-5c97-4a48-ab4b-41b93cc25658 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:20.425883 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94159ebd-9299-4b17-a457-0a1596383b78", "name": "network-vif-deleted", "tag": "a8852328-86fa-45d2-bff7-9c714476f4d6", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:20.426143 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-8a3886d0-5c97-4a48-ab4b-41b93cc25658 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:20.426546 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94159ebd-9299-4b17-a457-0a1596383b78', 'name': 'network-vif-deleted', 'tag': 'a8852328-86fa-45d2-bff7-9c714476f4d6', 'status': 'completed', 'code': 200} Nov 24 16:28:21.149230 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53170) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:21.559865 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:21.740865 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.080557 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Deleting port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:22.080898 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.157398 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] For port 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:22.158224 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.169567 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Calling delete_port for 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 owned by network:router_interface {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:22.403434 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.420787 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.434075 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Pushing event deleted for resources: {'Port': ['ID=89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:22.597334 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:22.649972 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:22.670964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:22.671316 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4c7fb83f-2fc0-48ef-9eb8-3cb5aebb5fdd not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:22.671734 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a8852328-86fa-45d2-bff7-9c714476f4d6 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:22.691544 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: a8852328-86fa-45d2-bff7-9c714476f4d6 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:22.691544 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a8852328-86fa-45d2-bff7-9c714476f4d6 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:22.790599 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806cb07c-dab1-4336-8d4f-4fea5c546f80 req-a77691fe-66c1-4f8a-a9b6-b705373806b4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:22.792113 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-806cb07c-dab1-4336-8d4f-4fea5c546f80 req-a77691fe-66c1-4f8a-a9b6-b705373806b4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0490813 Nov 24 16:28:22.815979 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Router 05159c2b-a330-441e-ab5d-008b311018b8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:28:22.838489 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-806cb07c-dab1-4336-8d4f-4fea5c546f80 req-d3133e95-9f2f-49f1-851a-f37b45ea3ea6 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405152 Nov 24 16:28:22.922959 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:28:22.927774 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-785fc6be-e427-476b-aaf3-841082e532bf admin admin] 10.222.0.82 "PUT /v2.0/routers/05159c2b-a330-441e-ab5d-008b311018b8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7774210 Nov 24 16:28:22.931182 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53186) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:22.934480 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9853c24a-984d-414c-88c0-898285853480 None None] Sync routers for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:28:22.946162 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:22.946780 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:28:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:23.036273 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks [] for router, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.054435 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:23.140467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.232467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:28:22Z', 'revision_number': 5, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port': {'id': 'c9525fbd-b614-4703-af12-ea71b0b3cce5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:b0:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05159c2b-a330-441e-ab5d-008b311018b8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:28Z', 'updated_at': '2021-11-24T16:24:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:23.254504 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Deleting port c9525fbd-b614-4703-af12-ea71b0b3cce5 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:23.255067 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.259820 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9853c24a-984d-414c-88c0-898285853480 None None] Checking router: 05159c2b-a330-441e-ab5d-008b311018b8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:28:23.268339 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] Routers {'05159c2b-a330-441e-ab5d-008b311018b8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:23.268939 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:28:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['05159c2b-a330-441e-ab5d-008b311018b8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:23.332322 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] For port c9525fbd-b614-4703-af12-ea71b0b3cce5, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=c9525fbd-b614-4703-af12-ea71b0b3cce5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:23.332703 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.344854 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Calling delete_port for c9525fbd-b614-4703-af12-ea71b0b3cce5 owned by network:router_gateway {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:23.355473 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] Set router 05159c2b-a330-441e-ab5d-008b311018b8 gateway port host: None {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:23.409603 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-9853c24a-984d-414c-88c0-898285853480 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:28:23Z', 'revision_number': 6, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:23.436434 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9853c24a-984d-414c-88c0-898285853480 None None] The sync data for ids ['05159c2b-a330-441e-ab5d-008b311018b8'] in dv-cinder-819007-2-iscsi is: [{'id': '05159c2b-a330-441e-ab5d-008b311018b8', 'name': 'tempest-TestMinimumBasicScenario-1342184024-router', 'tenant_id': '4562b21a9bec4777b36baec6291778f5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:27Z', 'updated_at': '2021-11-24T16:28:23Z', 'revision_number': 6, 'project_id': '4562b21a9bec4777b36baec6291778f5', 'gw_port_host': None}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:28:23.586018 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.614896 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Pushing event deleted for resources: {'Port': ['ID=c9525fbd-b614-4703-af12-ea71b0b3cce5,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:23.676578 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.780163 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.783342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.938121 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.938665 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 05159c2b-a330-441e-ab5d-008b311018b8 {{(pid=103141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:28:23.944428 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:23.945808 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-75880658-fd7a-4e6c-a37c-4ffbbe955808 admin admin] 10.222.0.82 "DELETE /v2.0/routers/05159c2b-a330-441e-ab5d-008b311018b8 HTTP/1.1" status: 204 len: 168 time: 1.0133798 Nov 24 16:28:23.948509 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53192) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:23.994363 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa316382-1ac3-439a-b09b-c767c1cd60bb req-f88a2ee1-3e61-4b1e-8934-f22821a6d9d8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:23.995900 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aa316382-1ac3-439a-b09b-c767c1cd60bb req-f88a2ee1-3e61-4b1e-8934-f22821a6d9d8 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0861590 Nov 24 16:28:24.014040 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Deleting subnet 32dfcce0-5f9f-4b5c-b446-29700080ce52 {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:24.024987 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.079556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25189480'] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.084189 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aa316382-1ac3-439a-b09b-c767c1cd60bb req-e244389d-573b-4417-a60e-01fcedd9177f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814152 Nov 24 16:28:24.153559 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:28:24.189348 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.203375 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:24.229747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:24.230100 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 89fd0b6a-ad9d-40fa-a7b4-38c7a5e7b522 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:24.308594 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25423536', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25555699'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.336450 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=32dfcce0-5f9f-4b5c-b446-29700080ce52,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:24.343571 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.346769 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-59875ac9-8f59-4670-b2d7-41a1cd740601 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/32dfcce0-5f9f-4b5c-b446-29700080ce52 HTTP/1.1" status: 204 len: 168 time: 0.3972719 Nov 24 16:28:24.349091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c6a18fa-87e2-4d47-9f4e-3f78012a1ad5 None None] Network 3244fb11-f411-4a53-b3cf-8285d8f01d99 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:24.349382 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53198) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:24.417156 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.476114 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Deleting port d65f1f32-61db-4746-b216-344fe99789f3 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:24.476567 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.537118 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] DHCP port deletion for 3244fb11-f411-4a53-b3cf-8285d8f01d99 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:28:24.555741 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] For port d65f1f32-61db-4746-b216-344fe99789f3, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d65f1f32-61db-4746-b216-344fe99789f3,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:24.556134 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.568386 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Calling delete_port for d65f1f32-61db-4746-b216-344fe99789f3 owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:24.590280 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Deleting port d65f1f32-61db-4746-b216-344fe99789f3 {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:24.590655 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.655271 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] For port d65f1f32-61db-4746-b216-344fe99789f3, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d65f1f32-61db-4746-b216-344fe99789f3,segment=NetworkSegment(95724655-bda4-4db3-b200-e095f21d8a6d),segment_id=95724655-bda4-4db3-b200-e095f21d8a6d)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:24.655738 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.668172 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Calling delete_port for d65f1f32-61db-4746-b216-344fe99789f3 owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:24.696946 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.724267 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Pushing event deleted for resources: {'Port': ['ID=d65f1f32-61db-4746-b216-344fe99789f3,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:24.731990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] No DVR routers for this DVR port d65f1f32-61db-4746-b216-344fe99789f3 on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:24.786535 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.799155 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.810963 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] Pushing event deleted for resources: {'Port': ['ID=d65f1f32-61db-4746-b216-344fe99789f3,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:24.814729 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbab0cc2-ae86-4ab6-a799-2f549d9f2347 None None] No DVR routers for this DVR port d65f1f32-61db-4746-b216-344fe99789f3 on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:24.833835 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3244fb11-f411-4a53-b3cf-8285d8f01d99']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:24.844411 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '95724655-bda4-4db3-b200-e095f21d8a6d') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:24.844708 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '95724655-bda4-4db3-b200-e095f21d8a6d') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:24.854130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.866550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-7644759e-b4bd-4120-bfb2-02baf63ad330 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:24.867832 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.868143 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-7644759e-b4bd-4120-bfb2-02baf63ad330 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0591602 Nov 24 16:28:24.873929 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Releasing vlan 861 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:24.874305 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:24.876136 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:24.971471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Deleting port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:24.971824 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.008663 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.017195 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.020478 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] 10.222.0.82 "DELETE /v2.0/networks/3244fb11-f411-4a53-b3cf-8285d8f01d99 HTTP/1.1" status: 204 len: 168 time: 0.6701655 Nov 24 16:28:25.029281 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53200) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:25.037287 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f16d499-35e1-4348-af04-8f9d0226d792 admin admin] Pushing event deleted for resources: {'Network': ['ID=3244fb11-f411-4a53-b3cf-8285d8f01d99,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:25.075178 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] For port 4b2ba5f2-f884-41f8-902c-cb9ddc407213, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=4b2ba5f2-f884-41f8-902c-cb9ddc407213,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:25.075836 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.090403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Calling delete_port for 4b2ba5f2-f884-41f8-902c-cb9ddc407213 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:25.270505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7772f2c3-50ea-4018-8012-0b60f55d64ec req-413f90d1-171a-4f15-98c8-ba0cc4b75982 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:25.272177 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7772f2c3-50ea-4018-8012-0b60f55d64ec req-413f90d1-171a-4f15-98c8-ba0cc4b75982 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 946 time: 0.0958591 Nov 24 16:28:25.318197 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.332923 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df', '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', '4b2ba5f2-f884-41f8-902c-cb9ddc407213'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:25.354151 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7772f2c3-50ea-4018-8012-0b60f55d64ec req-8d594b72-93b3-4ee0-a3e5-804dc462823d tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748520 Nov 24 16:28:25.356830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event deleted for resources: {'Port': ['ID=4b2ba5f2-f884-41f8-902c-cb9ddc407213,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:25.398157 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] No DVR routers for this DVR port 4b2ba5f2-f884-41f8-902c-cb9ddc407213 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:25.401173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.405323 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-11b7c36f-650b-4c84-b203-fbd65ed767d0 req-665347ae-96dc-4527-8e57-769ef886c50c tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "DELETE /v2.0/ports/4b2ba5f2-f884-41f8-902c-cb9ddc407213 HTTP/1.1" status: 204 len: 173 time: 0.5289629 Nov 24 16:28:25.405959 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'name': 'network-vif-deleted', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:25.408492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22c08e0c-054c-4c8d-92b4-62f889152fe9" -d '{"events": [{"server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "name": "network-vif-deleted", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:25.473930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd0c4c80-e0a4-44bf-9699-551dc4cac904 x-openstack-request-id: req-bd0c4c80-e0a4-44bf-9699-551dc4cac904 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:25.473930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "339c6af8-2d3c-4372-a1a2-aaecd2adac40", "name": "network-vif-deleted", "tag": "4b2ba5f2-f884-41f8-902c-cb9ddc407213", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:25.473930 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-bd0c4c80-e0a4-44bf-9699-551dc4cac904 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:25.473930 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '339c6af8-2d3c-4372-a1a2-aaecd2adac40', 'name': 'network-vif-deleted', 'tag': '4b2ba5f2-f884-41f8-902c-cb9ddc407213', 'status': 'completed', 'code': 200} Nov 24 16:28:25.657121 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device c9525fbd-b614-4703-af12-ea71b0b3cce5 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:25.662965 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.676693 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: c9525fbd-b614-4703-af12-ea71b0b3cce5 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:25.677118 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device c9525fbd-b614-4703-af12-ea71b0b3cce5 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:25.677586 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d65f1f32-61db-4746-b216-344fe99789f3 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:25.698684 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: d65f1f32-61db-4746-b216-344fe99789f3 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:25.699051 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d65f1f32-61db-4746-b216-344fe99789f3 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:25.906017 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Deleting port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:25.906273 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.982000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] For port 689a2b14-53de-4fd4-8fb1-2b656a2f8db9, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:25.982387 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:25.994998 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Calling delete_port for 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 owned by network:router_interface {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:26.225949 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:26.253685 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Pushing event deleted for resources: {'Port': ['ID=689a2b14-53de-4fd4-8fb1-2b656a2f8db9,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:26.451245 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:26.510554 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f036213e-af8a-4996-82f9-a6d4a3b57e1e req-33df911e-c71a-4707-b1e7-b0192d947d3a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=339c6af8-2d3c-4372-a1a2-aaecd2adac40 HTTP/1.1" status: 200 len: 210 time: 0.0268083 Nov 24 16:28:26.666525 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Router 17c49c91-aac3-4197-b22c-97f1162ad379 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:28:26.768589 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:28:26.773532 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d4fff7c1-9916-46f2-9ecd-aa3c4566276f admin admin] 10.222.0.82 "PUT /v2.0/routers/17c49c91-aac3-4197-b22c-97f1162ad379/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7427497 Nov 24 16:28:26.776275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53216) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:26.776914 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Sync routers for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:28:26.787324 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:26.787942 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:28:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:26.882869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:26.888753 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:26.984626 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.113749 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Deleting port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:27.114094 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.146341 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104'}], 'enable_snat': True}, 'gw_port_id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:28:26Z', 'revision_number': 5, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port': {'id': '9a8aa74c-7422-4d90-bc2d-24bf8d50817d', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:ff:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:24:35Z', 'updated_at': '2021-11-24T16:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:27.172319 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Checking router: 17c49c91-aac3-4197-b22c-97f1162ad379 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:28:27.180324 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Routers {'17c49c91-aac3-4197-b22c-97f1162ad379'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:28:27.180925 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:28:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['17c49c91-aac3-4197-b22c-97f1162ad379'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:27.191897 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] For port 9a8aa74c-7422-4d90-bc2d-24bf8d50817d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:27.192287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.205214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Calling delete_port for 9a8aa74c-7422-4d90-bc2d-24bf8d50817d owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:27.264803 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] Set router 17c49c91-aac3-4197-b22c-97f1162ad379 gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:28:27.319289 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:28:26Z', 'revision_number': 6, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:27.349899 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda57be4-3f21-4ce9-b69d-196e1550ce62 None None] The sync data for ids ['17c49c91-aac3-4197-b22c-97f1162ad379'] in dv-cinder-819007-2-iscsi is: [{'id': '17c49c91-aac3-4197-b22c-97f1162ad379', 'name': 'tempest-TestMinimumBasicScenario-984943225-router', 'tenant_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:24:34Z', 'updated_at': '2021-11-24T16:28:26Z', 'revision_number': 6, 'project_id': 'b3c83ff7d8a5476892879eb1d197c5ae', 'gw_port_host': None}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:28:27.428361 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.455989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Pushing event deleted for resources: {'Port': ['ID=9a8aa74c-7422-4d90-bc2d-24bf8d50817d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:27.520034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.615116 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.617282 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.740411 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.741024 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 17c49c91-aac3-4197-b22c-97f1162ad379 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:28:27.749152 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.749152 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b6a3cb90-f8c8-4f16-af42-d866bd9c202b admin admin] 10.222.0.82 "DELETE /v2.0/routers/17c49c91-aac3-4197-b22c-97f1162ad379 HTTP/1.1" status: 204 len: 168 time: 0.9700546 Nov 24 16:28:27.750433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53230) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:27.798498 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Deleting subnet 78fefca8-6dfc-4d51-afa6-7531a69831e6 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:27.801803 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.840961 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:27.971905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.022875 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e7826c-162c-45f1-a22d-bfcf710a0c4d req-1736dad1-928a-4a24-add1-15046d10eaaa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:28.029060 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-35e7826c-162c-45f1-a22d-bfcf710a0c4d req-1736dad1-928a-4a24-add1-15046d10eaaa tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0900378 Nov 24 16:28:28.080594 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-35e7826c-162c-45f1-a22d-bfcf710a0c4d req-08b6ef28-fc40-455c-8d4f-dd7f58f7d4c2 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489542 Nov 24 16:28:28.120214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.136831 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:28.147723 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=78fefca8-6dfc-4d51-afa6-7531a69831e6,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:28.150137 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:28.150625 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 689a2b14-53de-4fd4-8fb1-2b656a2f8db9 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:28.152629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.156395 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] 10.222.0.82 "DELETE /v2.0/subnets/78fefca8-6dfc-4d51-afa6-7531a69831e6 HTTP/1.1" status: 204 len: 168 time: 0.4042950 Nov 24 16:28:28.159109 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53238) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:28.161475 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.161829 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.162173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167383 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df4380b7-333d-4e9f-b566-772c9bc0aebf None None] Network 4a5b2498-2d18-46a7-9cde-172882bf566d requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.167492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bda40f3-f461-4a05-bbbd-110c1d33c93f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:28:28.234266 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.293234 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Deleting port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:28.293814 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.367709 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] DHCP port deletion for 4a5b2498-2d18-46a7-9cde-172882bf566d request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:28:28.379527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] For port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:28.379940 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.395338 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Calling delete_port for 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:28.430751 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Deleting port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:28.430751 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.542877 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.567356 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Pushing event deleted for resources: {'Port': ['ID=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:28.573947 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] No DVR routers for this DVR port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:28.617639 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] For port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,segment=NetworkSegment(eec903dc-62b4-41d9-ab39-748e8e72b762),segment_id=eec903dc-62b4-41d9-ab39-748e8e72b762)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:28.617960 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.630148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Calling delete_port for 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:28.639778 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4b2ba5f2-f884-41f8-902c-cb9ddc407213 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:28.652641 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.662213 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 4b2ba5f2-f884-41f8-902c-cb9ddc407213 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:28.662565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 4b2ba5f2-f884-41f8-902c-cb9ddc407213 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:28.674483 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4a5b2498-2d18-46a7-9cde-172882bf566d']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:28.684088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eec903dc-62b4-41d9-ab39-748e8e72b762') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:28.684338 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eec903dc-62b4-41d9-ab39-748e8e72b762') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:28.693598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.707322 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.713105 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Releasing vlan 855 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:28.713492 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:28.715147 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:28.726571 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.753903 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] Pushing event deleted for resources: {'Port': ['ID=0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:28.757273 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c12e91c1-ecbe-45bc-9c27-c134b1f7bdb2 None None] No DVR routers for this DVR port 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:28.831502 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.836750 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:28.840073 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] 10.222.0.82 "DELETE /v2.0/networks/4a5b2498-2d18-46a7-9cde-172882bf566d HTTP/1.1" status: 204 len: 168 time: 0.6794262 Nov 24 16:28:28.853206 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f7ce09-2a6a-48b8-99f2-e41a4b9e85ef admin admin] Pushing event deleted for resources: {'Network': ['ID=4a5b2498-2d18-46a7-9cde-172882bf566d,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:29.062618 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.199288 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b473e0b-2f37-4ca3-aee3-43ff6f3b0cc5 req-756a4230-ae9e-4926-b690-19f0a55311a0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:29.200711 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b473e0b-2f37-4ca3-aee3-43ff6f3b0cc5 req-756a4230-ae9e-4926-b690-19f0a55311a0 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0488963 Nov 24 16:28:29.224705 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53250) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:29.254531 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b473e0b-2f37-4ca3-aee3-43ff6f3b0cc5 req-81ea6f9e-5272-4f83-a772-e1799c4d7b82 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464189 Nov 24 16:28:29.269500 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c04bdee8-44ef-4f57-abf9-a857b3a77d4c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4562b21a9bec4777b36baec6291778f5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0433469 Nov 24 16:28:29.271936 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53252) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:29.318538 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.339304 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.448560 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.451240 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.452378 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/77b48aa8-a04d-471f-b619-b41c1aec3a12 HTTP/1.1" status: 204 len: 168 time: 0.1795433 Nov 24 16:28:29.460279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9daa9e7e-ecfe-4ebe-8394-4b31947505a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77b48aa8-a04d-471f-b619-b41c1aec3a12,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:29.512896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-adb53087-9e09-4fc5-b11c-421694bc8868 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:29.514451 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-adb53087-9e09-4fc5-b11c-421694bc8868 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 946 time: 0.0616553 Nov 24 16:28:29.622837 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Deleting port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:29.623246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.666863 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9a8aa74c-7422-4d90-bc2d-24bf8d50817d no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:29.687985 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 9a8aa74c-7422-4d90-bc2d-24bf8d50817d {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:29.688363 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9a8aa74c-7422-4d90-bc2d-24bf8d50817d not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:29.688769 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:29.707784 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:29.708062 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0dac0b25-2f4b-46cd-afc2-a1c0b7edacc2 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:29.721406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] For port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:29.721776 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.734404 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Calling delete_port for 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:29.928936 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:29.940315 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df', '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:29.957904 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event deleted for resources: {'Port': ['ID=9c3d5b59-da60-4d20-99e5-8b05cbf4d19d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:30.000404 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] No DVR routers for this DVR port 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:30.002798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:30.006184 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-acc6f12a-b648-4b6a-92d3-eab0a4268e1f req-b21a4964-fc46-427b-8810-f244944b4562 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "DELETE /v2.0/ports/9c3d5b59-da60-4d20-99e5-8b05cbf4d19d HTTP/1.1" status: 204 len: 173 time: 0.4853628 Nov 24 16:28:30.006643 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'name': 'network-vif-deleted', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:30.010646 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-591115c5-6e32-4dfe-8499-35897bf02619" -d '{"events": [{"server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "name": "network-vif-deleted", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:30.051837 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5908373b-ac41-4be2-9314-c4f051142ca0 x-openstack-request-id: req-5908373b-ac41-4be2-9314-c4f051142ca0 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:30.052130 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "59091430-6e78-4c62-8816-b0004df079a6", "name": "network-vif-deleted", "tag": "9c3d5b59-da60-4d20-99e5-8b05cbf4d19d", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:30.052408 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-5908373b-ac41-4be2-9314-c4f051142ca0 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:30.052784 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '59091430-6e78-4c62-8816-b0004df079a6', 'name': 'network-vif-deleted', 'tag': '9c3d5b59-da60-4d20-99e5-8b05cbf4d19d', 'status': 'completed', 'code': 200} Nov 24 16:28:30.166046 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53270) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:30.209046 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-0ee9498e-2686-4392-8227-510ece51aa38 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b3c83ff7d8a5476892879eb1d197c5ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0395246 Nov 24 16:28:30.209700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53272) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:30.261180 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:30.286693 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:30.366643 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0f05a312-b9b4-46c0-961b-4dbd988e0a88 req-a3e7ca4f-a0bc-46ec-bfe0-b30ae22a5e3f tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=59091430-6e78-4c62-8816-b0004df079a6 HTTP/1.1" status: 200 len: 210 time: 0.0304146 Nov 24 16:28:30.476451 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a6d184-a3cc-422d-b1d1-20bee1e8c677 req-9b4a1ac9-eefa-4b1e-9dc5-38dac970059d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:30.477950 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-70a6d184-a3cc-422d-b1d1-20bee1e8c677 req-9b4a1ac9-eefa-4b1e-9dc5-38dac970059d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0490668 Nov 24 16:28:30.479188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:30.481759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:30.482787 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/cb75dcfe-38bb-46c9-9861-d5f21a4d25c9 HTTP/1.1" status: 204 len: 168 time: 0.2726586 Nov 24 16:28:30.504584 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad67f6e8-3602-47c6-8a15-566bccca1d2c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb75dcfe-38bb-46c9-9861-d5f21a4d25c9,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:30.545660 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-70a6d184-a3cc-422d-b1d1-20bee1e8c677 req-473b08e9-c366-4117-b4b6-edea76f4e695 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617974 Nov 24 16:28:31.704809 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd36de96-aa27-4601-b7cd-f5e96db5e5f3 req-1d983b2b-c00e-4470-92a6-bda321eb206a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:31.706185 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cd36de96-aa27-4601-b7cd-f5e96db5e5f3 req-1d983b2b-c00e-4470-92a6-bda321eb206a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0524576 Nov 24 16:28:31.752648 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cd36de96-aa27-4601-b7cd-f5e96db5e5f3 req-641d62e2-0a01-4058-b421-94e9fa4837c8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403652 Nov 24 16:28:32.874128 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c19fced-3c92-4891-839b-0985c58b34a3 req-6a6285c1-9471-4278-baba-ffe166cf2eb2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:32.875641 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7c19fced-3c92-4891-839b-0985c58b34a3 req-6a6285c1-9471-4278-baba-ffe166cf2eb2 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0494442 Nov 24 16:28:32.926368 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7c19fced-3c92-4891-839b-0985c58b34a3 req-6eca4f47-37c8-449f-97f4-604563ec059b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448301 Nov 24 16:28:33.146996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077f71bf-9adc-4acc-a16a-0685e7204469 req-4444fea2-f2a2-47d9-bc67-d38bb27201e5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:33.148484 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-077f71bf-9adc-4acc-a16a-0685e7204469 req-4444fea2-f2a2-47d9-bc67-d38bb27201e5 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0495598 Nov 24 16:28:33.221913 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-077f71bf-9adc-4acc-a16a-0685e7204469 req-e60a772c-9273-4f32-977a-acf0b4bd584a tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657184 Nov 24 16:28:33.228647 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-bbdf6377-d30e-4bba-88a2-57d7d4c8fbde service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0597708 Nov 24 16:28:33.310935 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-71a28b7f-76a0-4812-a9cd-cb5d41c2334d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:33.312412 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-71a28b7f-76a0-4812-a9cd-cb5d41c2334d service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.0397995 Nov 24 16:28:33.425337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-293f4b52-476c-42b3-8827-bddd6ff0ac37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:33.426794 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-293f4b52-476c-42b3-8827-bddd6ff0ac37 service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.0937514 Nov 24 16:28:33.495431 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-5be3ae51-09b7-41ce-a287-92c7f3c9130d service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 1001 time: 0.0594449 Nov 24 16:28:33.544681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-3149c41a-0fdf-48e3-a74d-b3380a61fe40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:33.546100 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-3149c41a-0fdf-48e3-a74d-b3380a61fe40 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.0430777 Nov 24 16:28:33.593770 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-5bbd3ead-00c5-4120-a152-0d1780edfdec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:33.600488 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-5bbd3ead-00c5-4120-a152-0d1780edfdec service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400944 Nov 24 16:28:33.687734 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-f16fe72d-228d-4cb8-babe-0552f8301fb6 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834074 Nov 24 16:28:33.784189 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-33893855-7e7c-4039-bb40-0d3de08acec8 req-73704e89-6800-413c-920a-9fe7872ef0e6 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830836 Nov 24 16:28:34.049083 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d09e6c-54e4-4e29-9601-41c6c31d6513 req-fa488d99-cf61-4fd6-a182-a2bd7e37b3e9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:34.050632 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-92d09e6c-54e4-4e29-9601-41c6c31d6513 req-fa488d99-cf61-4fd6-a182-a2bd7e37b3e9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0528612 Nov 24 16:28:34.097541 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-92d09e6c-54e4-4e29-9601-41c6c31d6513 req-771fa19a-67c5-441d-adb8-f02f27246c71 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409863 Nov 24 16:28:34.345044 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c4c002-723b-4bd8-8faa-85cdcb7a83fe req-bb7655ae-669c-41a1-921f-763464c56fd9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:34.346438 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60c4c002-723b-4bd8-8faa-85cdcb7a83fe req-bb7655ae-669c-41a1-921f-763464c56fd9 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0546236 Nov 24 16:28:34.400247 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-60c4c002-723b-4bd8-8faa-85cdcb7a83fe req-cafc1bf5-c5e4-4c03-be3a-b1f6cf13ae55 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/security-groups?id=55a1668a-6664-4543-844d-6eb1d55ac0a9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478907 Nov 24 16:28:34.675611 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:34.695784 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:34.696135 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9c3d5b59-da60-4d20-99e5-8b05cbf4d19d not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:34.937191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-5efb87ce-62a3-4314-b425-a92e5a8163f4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:34.938523 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-5efb87ce-62a3-4314-b425-a92e5a8163f4 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 945 time: 0.0466897 Nov 24 16:28:35.027643 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Deleting port 762850ae-1576-4b2b-ab96-dc7301eb36df {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:28:35.027977 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:35.116141 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] For port 762850ae-1576-4b2b-ab96-dc7301eb36df, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=762850ae-1576-4b2b-ab96-dc7301eb36df,segment=NetworkSegment(f3c6a933-35bb-4586-9209-7b535731374f),segment_id=f3c6a933-35bb-4586-9209-7b535731374f)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:35.116508 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:35.130280 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Calling delete_port for 762850ae-1576-4b2b-ab96-dc7301eb36df owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:28:35.249282 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3bcdc6d-07f0-4c7d-973f-2f09902f9fc5 req-eb06a1c8-e9b3-4f3d-b31b-6cf4d14e062b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:35.250786 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c3bcdc6d-07f0-4c7d-973f-2f09902f9fc5 req-eb06a1c8-e9b3-4f3d-b31b-6cf4d14e062b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0724647 Nov 24 16:28:35.335662 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c3bcdc6d-07f0-4c7d-973f-2f09902f9fc5 req-b107a695-02b8-4d9c-80cb-f8be73ad816e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789831 Nov 24 16:28:35.375000 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:35.388256 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['762850ae-1576-4b2b-ab96-dc7301eb36df'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:35.407057 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Pushing event deleted for resources: {'Port': ['ID=762850ae-1576-4b2b-ab96-dc7301eb36df,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:35.450945 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] No DVR routers for this DVR port 762850ae-1576-4b2b-ab96-dc7301eb36df on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:28:35.453467 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:35.456929 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-468c14b0-53a6-49e9-9eae-ab06c0c0c6d6 req-a9b1dcde-75be-41e8-81c0-8e994fcf9a58 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.84 "DELETE /v2.0/ports/762850ae-1576-4b2b-ab96-dc7301eb36df HTTP/1.1" status: 204 len: 173 time: 0.5106640 Nov 24 16:28:35.457373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'name': 'network-vif-deleted', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:35.459717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e83fd55d-1695-4c76-89dc-f574e04ed866" -d '{"events": [{"server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "name": "network-vif-deleted", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:35.496973 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d4658c6-8860-4737-8ac9-55f040d3bfa4 x-openstack-request-id: req-1d4658c6-8860-4737-8ac9-55f040d3bfa4 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:35.497456 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17edb15b-10e6-4cf2-a284-a14cf1e1eb68", "name": "network-vif-deleted", "tag": "762850ae-1576-4b2b-ab96-dc7301eb36df", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:35.497713 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-1d4658c6-8860-4737-8ac9-55f040d3bfa4 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:35.498144 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17edb15b-10e6-4cf2-a284-a14cf1e1eb68', 'name': 'network-vif-deleted', 'tag': '762850ae-1576-4b2b-ab96-dc7301eb36df', 'status': 'completed', 'code': 200} Nov 24 16:28:35.500992 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ea2e7682-f7d2-408d-874b-b6031e9da19f req-98f936ec-3e6b-4749-ac07-6177bd12ff46 tempest-AttachVolumeNegativeTest-458276672 tempest-AttachVolumeNegativeTest-458276672-project] 10.222.0.82 "GET /v2.0/ports?device_id=17edb15b-10e6-4cf2-a284-a14cf1e1eb68 HTTP/1.1" status: 200 len: 210 time: 0.0275874 Nov 24 16:28:36.465858 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8904f589-9e76-4d50-87d7-27281cc044ed req-76682590-ec39-4ba6-a59e-3d474e7f5740 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:36.467340 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8904f589-9e76-4d50-87d7-27281cc044ed req-76682590-ec39-4ba6-a59e-3d474e7f5740 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0525289 Nov 24 16:28:36.515916 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8904f589-9e76-4d50-87d7-27281cc044ed req-d6bedcc6-0009-4872-bfac-7a9c86de5070 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416021 Nov 24 16:28:36.559309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53326) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:36.603619 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Deleting subnet 0b71499c-2eb4-4056-877a-cc924aa6fe1f {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:36.606601 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.639933 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.678150 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.799620 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.826868 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0b71499c-2eb4-4056-877a-cc924aa6fe1f,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:36.832895 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.836104 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2aaa53ad-9e41-4978-a1c3-44cb023dca76 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/0b71499c-2eb4-4056-877a-cc924aa6fe1f HTTP/1.1" status: 204 len: 168 time: 0.2752306 Nov 24 16:28:36.838538 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53328) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:36.904654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:36.985259 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.005788 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['24dab433-4f5d-49db-b2f0-46e992af618f']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:37.015672 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f3c6a933-35bb-4586-9209-7b535731374f') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:37.015971 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f3c6a933-35bb-4586-9209-7b535731374f') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:37.025072 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.038332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.044097 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Releasing vlan 873 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:37.044478 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:37.046110 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:37.164796 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.170280 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.173357 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] 10.222.0.82 "DELETE /v2.0/networks/24dab433-4f5d-49db-b2f0-46e992af618f HTTP/1.1" status: 204 len: 168 time: 0.3338852 Nov 24 16:28:37.183864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0cd217-6659-401c-9543-fbb07ba3b5d7 admin admin] Pushing event deleted for resources: {'Network': ['ID=24dab433-4f5d-49db-b2f0-46e992af618f,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:37.538580 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53334) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:37.578737 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-1afa363c-0761-476f-a971-68535e6d4529 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4e6a8ec37517478d90f3886b61b1beb6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0395069 Nov 24 16:28:37.581208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53338) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:37.628572 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.649590 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.664571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029dafb2-9c67-490a-b14f-c78fff0fac84 req-a3cbd92a-0632-443d-b6dd-2021afcca448 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:37.666051 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-029dafb2-9c67-490a-b14f-c78fff0fac84 req-a3cbd92a-0632-443d-b6dd-2021afcca448 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0721824 Nov 24 16:28:37.713281 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-029dafb2-9c67-490a-b14f-c78fff0fac84 req-dc13a2de-8b73-4609-bb86-fb228df70df0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407500 Nov 24 16:28:37.768372 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.771088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:37.772227 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/55a1668a-6664-4543-844d-6eb1d55ac0a9 HTTP/1.1" status: 204 len: 168 time: 0.1901157 Nov 24 16:28:37.780088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-942fd067-7253-4a8a-92d5-90baac14de37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55a1668a-6664-4543-844d-6eb1d55ac0a9,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:38.700100 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 762850ae-1576-4b2b-ab96-dc7301eb36df no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:28:38.720126 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 762850ae-1576-4b2b-ab96-dc7301eb36df {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:28:38.720423 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53362) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:38.720952 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 762850ae-1576-4b2b-ab96-dc7301eb36df not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:28:38.815394 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-198943893-network', 'tenant_id': 'a9a14f826f2b4c53a0c3f8d5f2268920'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:28:38.846679 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1e9fd2-df64-4b35-a1e1-6625b212df41 req-7c4c84c3-e1b2-4b49-82b0-0a606229da8b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:38.850995 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a1e9fd2-df64-4b35-a1e1-6625b212df41 req-7c4c84c3-e1b2-4b49-82b0-0a606229da8b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0649776 Nov 24 16:28:38.891700 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Made reservation on behalf of a9a14f826f2b4c53a0c3f8d5f2268920 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:28:38.893955 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:38.899611 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6a1e9fd2-df64-4b35-a1e1-6625b212df41 req-759f44d8-1100-440d-8b37-29f2034da800 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453682 Nov 24 16:28:38.906184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:38.980200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.065466 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.090482 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 887} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:28:39.100811 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e070332-a078-4fc9-ad1a-ea33170793cb,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:39.105692 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.106040 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Added segment 3fc74cb8-f797-440e-a132-5f9706198afe of type vlan for network 16134a9d-110a-4330-8e1d-26506cb08f27 Nov 24 16:28:39.145731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.231219 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.232160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:39.232756 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.290645 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] Pushing event updated for resources: {'Network': ['ID=16134a9d-110a-4330-8e1d-26506cb08f27,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:39.300711 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 16134a9d-110a-4330-8e1d-26506cb08f27 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:28:39.333646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c6547028-d391-4e72-b8b0-3845e644455e admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6119184 Nov 24 16:28:39.336357 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53368) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:39.341127 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Request body: {'subnet': {'network_id': '16134a9d-110a-4330-8e1d-26506cb08f27', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-198943893-subnet', 'tenant_id': 'a9a14f826f2b4c53a0c3f8d5f2268920', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:28:39.428218 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Made reservation on behalf of a9a14f826f2b4c53a0c3f8d5f2268920 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:28:39.430931 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25215965'] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.645120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-26164714', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25215951'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.704727 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b6292fa5-3041-4e79-ba9f-faf754abfe59,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:39.714277 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Checking segment: {'id': '3fc74cb8-f797-440e-a132-5f9706198afe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': '16134a9d-110a-4330-8e1d-26506cb08f27'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:28:39.714640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Network hostable DHCP agents. Network: 16134a9d-110a-4330-8e1d-26506cb08f27, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:28:39.813826 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Network 16134a9d-110a-4330-8e1d-26506cb08f27 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:28:39.893900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 16134a9d-110a-4330-8e1d-26506cb08f27) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:28:39.899659 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:39.900620 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:39.901393 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e869047-4702-4020-963a-f8d3621cfeba None None] Network 16134a9d-110a-4330-8e1d-26506cb08f27 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:40.003642 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dd006be5-fd7a-48b3-91ba-d1c2541ef335 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.6661515 Nov 24 16:28:40.024877 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0196a94-c1a5-4b10-8fad-ff75d6f704b0 req-c6909751-ecfd-490f-ba62-a3b74faca660 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:40.026293 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f0196a94-c1a5-4b10-8fad-ff75d6f704b0 req-c6909751-ecfd-490f-ba62-a3b74faca660 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0544438 Nov 24 16:28:40.029405 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a5dbc1b-af05-41d5-af86-503f2c2b6b68 None None] Network 16134a9d-110a-4330-8e1d-26506cb08f27 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:40.077932 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f0196a94-c1a5-4b10-8fad-ff75d6f704b0 req-1aa407bd-90fe-4199-b9f7-234b481caa55 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436537 Nov 24 16:28:40.710846 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53390) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:40.715788 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-699209925-network', 'tenant_id': 'c03efe7ac50c4a7ab7cf3181a76cf343'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:28:40.814164 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Made reservation on behalf of c03efe7ac50c4a7ab7cf3181a76cf343 for: {'network': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:28:40.816681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:40.825765 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:40.896417 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:40.959195 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:40.984183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=103142) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:28:40.992916 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8debf7c-ec72-45b7-9311-83452f0b2314,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:40.998537 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.000475 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.segments_db [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Added segment 52d2cc93-9ef6-4847-87ab-893c40de61dc of type vlan for network f7b01f97-13e8-431a-ac01-9b04e41b9035 Nov 24 16:28:41.040038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.136604 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.137674 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:41.138290 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.224808 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] Pushing event updated for resources: {'Network': ['ID=f7b01f97-13e8-431a-ac01-9b04e41b9035,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:41.231936 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-328d8acb-6d55-4fea-a516-86771faa4e4f admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.5200131 Nov 24 16:28:41.235467 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53394) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:41.238395 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network f7b01f97-13e8-431a-ac01-9b04e41b9035 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:28:41.240549 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Request body: {'subnet': {'network_id': 'f7b01f97-13e8-431a-ac01-9b04e41b9035', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-699209925-subnet', 'tenant_id': 'c03efe7ac50c4a7ab7cf3181a76cf343', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:28:41.249545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d589f0-ee23-4aa8-81bf-e8417a8ab2a0 req-0215d28c-c93c-45ac-a8fd-920dbedad484 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:41.251279 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-15d589f0-ee23-4aa8-81bf-e8417a8ab2a0 req-0215d28c-c93c-45ac-a8fd-920dbedad484 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0940440 Nov 24 16:28:41.300586 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-15d589f0-ee23-4aa8-81bf-e8417a8ab2a0 req-2b22b075-2ed6-4328-b8b3-0c8b7fbc02cf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419652 Nov 24 16:28:41.336604 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Made reservation on behalf of c03efe7ac50c4a7ab7cf3181a76cf343 for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:28:41.338966 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.554113 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.607747 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3286079d-6b8e-4937-88ba-7701c9923a57,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:41.618470 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Checking segment: {'id': '52d2cc93-9ef6-4847-87ab-893c40de61dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'f7b01f97-13e8-431a-ac01-9b04e41b9035'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:28:41.618958 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Network hostable DHCP agents. Network: f7b01f97-13e8-431a-ac01-9b04e41b9035, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:28:41.687821 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Network f7b01f97-13e8-431a-ac01-9b04e41b9035 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:28:41.779639 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, f7b01f97-13e8-431a-ac01-9b04e41b9035) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:28:41.785598 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:41.789515 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:41.789654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f008ebc4-d18d-4177-8857-11d4a2668026 None None] Network f7b01f97-13e8-431a-ac01-9b04e41b9035 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:41.875695 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-42bd7a9d-0d58-4049-a9c8-f114b3bf4158 admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.6314304 Nov 24 16:28:41.914870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf12419a-94a6-4c12-9a80-9eb4d18f1a4f None None] Network f7b01f97-13e8-431a-ac01-9b04e41b9035 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:28:41.978000 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53400) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:42.023844 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Deleting subnet b6292fa5-3041-4e79-ba9f-faf754abfe59 {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:42.027089 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.062708 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25189480'] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.100504 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.231277 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25423536', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25555699'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.256590 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b6292fa5-3041-4e79-ba9f-faf754abfe59,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:42.260385 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.263596 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b7e85754-921f-4bde-8343-b02e3916698c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/b6292fa5-3041-4e79-ba9f-faf754abfe59 HTTP/1.1" status: 204 len: 168 time: 0.2846134 Nov 24 16:28:42.266167 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53402) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:42.331683 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.417762 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.434319 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c27f4d-1582-4f6c-80c5-603b70888d64 req-1ddc57bc-90c9-4905-8ec1-850f3259d2a4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:42.435841 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b8c27f4d-1582-4f6c-80c5-603b70888d64 req-1ddc57bc-90c9-4905-8ec1-850f3259d2a4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0525022 Nov 24 16:28:42.437682 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16134a9d-110a-4330-8e1d-26506cb08f27']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:42.447063 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3fc74cb8-f797-440e-a132-5f9706198afe') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:42.447367 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3fc74cb8-f797-440e-a132-5f9706198afe') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:42.456727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.470012 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.475927 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Releasing vlan 887 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:42.476313 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:42.477969 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:42.482536 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b8c27f4d-1582-4f6c-80c5-603b70888d64 req-335b806c-e3bd-451f-bc6b-19700798a627 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406129 Nov 24 16:28:42.613730 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.618943 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.622072 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] 10.222.0.82 "DELETE /v2.0/networks/16134a9d-110a-4330-8e1d-26506cb08f27 HTTP/1.1" status: 204 len: 168 time: 0.3550069 Nov 24 16:28:42.625103 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53406) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:42.632635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7280587-988f-4a3b-9238-5a8bd7e8fb3d admin admin] Pushing event deleted for resources: {'Network': ['ID=16134a9d-110a-4330-8e1d-26506cb08f27,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:42.671623 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Deleting subnet 3286079d-6b8e-4937-88ba-7701c9923a57 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:28:42.674671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:42.972423 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.010556 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.123209 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.149539 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3286079d-6b8e-4937-88ba-7701c9923a57,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:43.151546 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.154732 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1d359447-a49f-49ac-8cb7-8acd43832b19 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/3286079d-6b8e-4937-88ba-7701c9923a57 HTTP/1.1" status: 204 len: 168 time: 0.5286384 Nov 24 16:28:43.157853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53410) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:43.227440 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.302425 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.325005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7b01f97-13e8-431a-ac01-9b04e41b9035']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:43.333943 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52d2cc93-9ef6-4847-87ab-893c40de61dc') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:43.334234 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52d2cc93-9ef6-4847-87ab-893c40de61dc') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:28:43.344016 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.356488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.362822 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Releasing vlan 854 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:28:43.363235 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:28:43.364815 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:28:43.479259 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.484433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.487598 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] 10.222.0.82 "DELETE /v2.0/networks/f7b01f97-13e8-431a-ac01-9b04e41b9035 HTTP/1.1" status: 204 len: 168 time: 0.3288229 Nov 24 16:28:43.497890 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0297d2-bb17-4608-a9d0-0627273a3589 admin admin] Pushing event deleted for resources: {'Network': ['ID=f7b01f97-13e8-431a-ac01-9b04e41b9035,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:43.609617 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6880340c-0626-44f4-b28c-adbd008f0a27 req-35b02a9d-e890-4e4f-a917-c8fd049bebd5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:43.611132 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6880340c-0626-44f4-b28c-adbd008f0a27 req-35b02a9d-e890-4e4f-a917-c8fd049bebd5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0495031 Nov 24 16:28:43.661263 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6880340c-0626-44f4-b28c-adbd008f0a27 req-07d1e80d-ba0a-4873-8472-d9a1e88010df tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441303 Nov 24 16:28:43.882540 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53416) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:43.921632 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e882ef4d-646d-480f-8764-530e4f8146ee admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a9a14f826f2b4c53a0c3f8d5f2268920&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0379357 Nov 24 16:28:43.924647 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53418) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:43.971508 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:43.992635 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.119311 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.123204 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.123316 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/7e070332-a078-4fc9-ad1a-ea33170793cb HTTP/1.1" status: 204 len: 168 time: 0.1975539 Nov 24 16:28:44.130996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151bb6f0-0617-41ac-8102-3ee39dab7c7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e070332-a078-4fc9-ad1a-ea33170793cb,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:44.723898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53428) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:44.793557 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b2cb5c19-b72d-4599-993b-302be47dd2fd admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c03efe7ac50c4a7ab7cf3181a76cf343&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0684814 Nov 24 16:28:44.796207 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53430) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:28:44.805639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310f2e92-3c2b-4289-98cf-d2b2c28bdf5b req-0802fa88-f0f2-4b75-a883-2a2d1fbd78dd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:44.807124 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-310f2e92-3c2b-4289-98cf-d2b2c28bdf5b req-0802fa88-f0f2-4b75-a883-2a2d1fbd78dd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0696721 Nov 24 16:28:44.844122 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.854144 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-310f2e92-3c2b-4289-98cf-d2b2c28bdf5b req-24d724e5-8c0b-4499-a773-0e9cd6e34953 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401537 Nov 24 16:28:44.865174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.982028 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.985127 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:44.986307 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a8debf7c-ec72-45b7-9311-83452f0b2314 HTTP/1.1" status: 204 len: 168 time: 0.1891000 Nov 24 16:28:44.994587 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8c0134-3c29-4b5d-94b4-2d9628c28d7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8debf7c-ec72-45b7-9311-83452f0b2314,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:45.973008 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7fd5e6-9ba5-4147-8fef-4119c1070035 req-2de41d39-a0f2-4a3a-9d7d-e5e6c9b6976e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:45.974522 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ad7fd5e6-9ba5-4147-8fef-4119c1070035 req-2de41d39-a0f2-4a3a-9d7d-e5e6c9b6976e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0494635 Nov 24 16:28:46.024132 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ad7fd5e6-9ba5-4147-8fef-4119c1070035 req-6d94d61d-d236-436d-87a1-6324c012d896 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425730 Nov 24 16:28:46.931351 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ff56ea65-b447-48ea-a760-1d923ac0cffb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:47.146373 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7785d61c-498b-431c-8ed4-d802049f6a41 req-70fce17a-8258-47a8-ab03-f8a48e6d335b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:47.147884 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7785d61c-498b-431c-8ed4-d802049f6a41 req-70fce17a-8258-47a8-ab03-f8a48e6d335b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0497787 Nov 24 16:28:47.193860 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7785d61c-498b-431c-8ed4-d802049f6a41 req-a7892683-2d10-4f96-803f-9b9f560edc63 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402045 Nov 24 16:28:48.324526 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e55283-2fbd-49fd-8b52-24780df99de6 req-20683e8b-5f6f-42eb-93e3-c5d190ab8c35 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:48.326010 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-34e55283-2fbd-49fd-8b52-24780df99de6 req-20683e8b-5f6f-42eb-93e3-c5d190ab8c35 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0554309 Nov 24 16:28:48.375675 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-34e55283-2fbd-49fd-8b52-24780df99de6 req-cbce777b-65ed-42c7-8ce7-11e67242ac03 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435967 Nov 24 16:28:48.743635 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:28:48.858091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:48.870738 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:28:48.909260 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:48.926528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:28:48.948178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:49.032087 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:49.093565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=6']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:49.124814 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:28:49.253298 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-37592d51-9792-498c-b589-399b8cb32d84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:49.510380 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570713ca-8322-4cde-8ed1-185c12752af9 req-8753c6c6-03ae-442d-8f9c-f70eb5e7536d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:49.512058 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-570713ca-8322-4cde-8ed1-185c12752af9 req-8753c6c6-03ae-442d-8f9c-f70eb5e7536d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0595341 Nov 24 16:28:49.567295 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-570713ca-8322-4cde-8ed1-185c12752af9 req-da61b789-e489-427e-a3e9-2d2764f159ec tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490594 Nov 24 16:28:50.398762 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:50.707313 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab4b618b-b7f2-4669-a24a-5d898f2ef30d req-25330a5c-9a66-4d12-bfbb-51a120729232 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:50.711521 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ab4b618b-b7f2-4669-a24a-5d898f2ef30d req-25330a5c-9a66-4d12-bfbb-51a120729232 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0630596 Nov 24 16:28:50.782721 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ab4b618b-b7f2-4669-a24a-5d898f2ef30d req-81605f08-07dc-492e-bc5a-fe124c30f03f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630164 Nov 24 16:28:51.457025 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:28:51.505516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:28:51.505893 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:51.586445 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:51.612305 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:28:51.614516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a566a68-23ef-4e00-8c30-e059153dd1d6" -d '{"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:28:51.627301 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:28:51.653116 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:28:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5355cb1b-a9ab-43f4-bbd4-0483906857eb x-openstack-request-id: req-5355cb1b-a9ab-43f4-bbd4-0483906857eb {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:28:51.653424 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:28:51.653681 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-5355cb1b-a9ab-43f4-bbd4-0483906857eb {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:28:51.654061 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'code': 200} Nov 24 16:28:51.736783 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:51.803249 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:51.809548 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=7']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:28:51.912616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae2163e-4758-4e9b-96eb-57fef29d668d req-0a8a3d1c-e6a9-44fe-ab6b-228c7ba03858 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:51.914244 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6ae2163e-4758-4e9b-96eb-57fef29d668d req-0a8a3d1c-e6a9-44fe-ab6b-228c7ba03858 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0554211 Nov 24 16:28:51.966994 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6ae2163e-4758-4e9b-96eb-57fef29d668d req-ed03c6d1-f760-4f16-b4de-2089f93578fe tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459340 Nov 24 16:28:52.429721 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:53.102130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8704748-341a-44f2-bdc7-44c65aed43c9 req-0ca7753a-ee4c-46ec-a7c8-a48c6f9f3613 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:53.111470 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e8704748-341a-44f2-bdc7-44c65aed43c9 req-0ca7753a-ee4c-46ec-a7c8-a48c6f9f3613 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0651283 Nov 24 16:28:53.163600 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e8704748-341a-44f2-bdc7-44c65aed43c9 req-d12a03d9-3e32-4e09-bf37-2aea51f85793 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510476 Nov 24 16:28:54.297985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f096d9de-a5f3-4dc7-996c-f3fa6a958988 req-43285ebf-3b77-4be9-9bfd-142606f477ce tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:54.299632 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f096d9de-a5f3-4dc7-996c-f3fa6a958988 req-43285ebf-3b77-4be9-9bfd-142606f477ce tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0558243 Nov 24 16:28:54.348109 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f096d9de-a5f3-4dc7-996c-f3fa6a958988 req-c0d6219c-0cfa-4f1b-8492-8a9e2d5898bd tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424318 Nov 24 16:28:55.475475 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fc575f-c1de-4579-8f61-6fa8eeebf9b8 req-289df725-ae3b-409f-bd05-516fcf6c132b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:55.477015 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-59fc575f-c1de-4579-8f61-6fa8eeebf9b8 req-289df725-ae3b-409f-bd05-516fcf6c132b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0506895 Nov 24 16:28:55.527379 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-59fc575f-c1de-4579-8f61-6fa8eeebf9b8 req-87bd0dc1-77bb-4daa-846f-bb41d74bd0a5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439503 Nov 24 16:28:56.661901 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06057db9-2a87-45eb-bc61-b3e34a239233 req-580b3c0c-26b0-4d1b-925b-0c263b732e94 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:56.667387 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06057db9-2a87-45eb-bc61-b3e34a239233 req-580b3c0c-26b0-4d1b-925b-0c263b732e94 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0625343 Nov 24 16:28:56.714404 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06057db9-2a87-45eb-bc61-b3e34a239233 req-447d9422-a4d6-4370-b5f2-b10aff0bf017 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451515 Nov 24 16:28:57.840780 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d320e1f-e8f6-479b-9701-57d076e611e1 req-755e583c-e593-4d55-9f2b-f5d1733a3f24 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:57.842848 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d320e1f-e8f6-479b-9701-57d076e611e1 req-755e583c-e593-4d55-9f2b-f5d1733a3f24 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0533118 Nov 24 16:28:57.893078 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1d320e1f-e8f6-479b-9701-57d076e611e1 req-39699cde-9885-4a75-9984-31f728c51876 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436714 Nov 24 16:28:59.017009 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce756b28-63a2-4291-87c3-98a14d96e27d req-764f523f-fe62-4169-b53f-6e9485dd5a21 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:59.018500 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ce756b28-63a2-4291-87c3-98a14d96e27d req-764f523f-fe62-4169-b53f-6e9485dd5a21 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0488875 Nov 24 16:28:59.044806 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:28:59.065157 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ce756b28-63a2-4291-87c3-98a14d96e27d req-ca3ab813-0d4f-422d-9888-8fad66d794de tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406601 Nov 24 16:28:59.754721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-834a8feb-c462-4946-ac97-576d74820014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:59.755065 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-834a8feb-c462-4946-ac97-576d74820014 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1098 time: 0.0473995 Nov 24 16:28:59.849861 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-eefded61-b7ff-4de4-950a-524e3dc09b09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:59.851379 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-eefded61-b7ff-4de4-950a-524e3dc09b09 service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.0885451 Nov 24 16:28:59.920294 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-000631cc-ebf7-4f31-80ad-1cf56887cfe7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 1001 time: 0.0618443 Nov 24 16:28:59.971154 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-ed9314d3-c75b-476a-b35d-1e54f4f51539 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:28:59.977016 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-ed9314d3-c75b-476a-b35d-1e54f4f51539 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0447495 Nov 24 16:29:00.017826 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-2200b057-6847-4923-a71f-37de1a7091b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:00.019355 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-2200b057-6847-4923-a71f-37de1a7091b4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402410 Nov 24 16:29:00.118582 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-b02dfaff-9ceb-4ecb-992d-f5d66ae46d14 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916457 Nov 24 16:29:00.193124 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20e0426-6279-423d-a718-b38abcbcf09a req-6e0f8a35-b874-41db-870e-c3310a6f18cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:00.194852 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e20e0426-6279-423d-a718-b38abcbcf09a req-6e0f8a35-b874-41db-870e-c3310a6f18cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0498722 Nov 24 16:29:00.213422 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c8683f7-1a36-4cae-a8ca-5948678eac27 req-4eb436df-7265-4f53-9fb1-6587d2400795 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874517 Nov 24 16:29:00.243468 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e20e0426-6279-423d-a718-b38abcbcf09a req-b78a0170-a5e2-4e33-b9c8-89ef75c63624 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423155 Nov 24 16:29:01.153215 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:29:01.362171 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49577f1-65a3-4b33-8046-3c3d17969ce8 req-050be91e-0ac2-4acd-86a8-be781711797f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:01.363669 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f49577f1-65a3-4b33-8046-3c3d17969ce8 req-050be91e-0ac2-4acd-86a8-be781711797f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0478730 Nov 24 16:29:01.409322 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f49577f1-65a3-4b33-8046-3c3d17969ce8 req-eb8d84ab-baf4-4070-be45-2e13205ee9db tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398047 Nov 24 16:29:02.531232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a115aa3-3761-428a-b449-60e6e3122f8e req-df2d95b9-4939-4b19-82c8-cf4bf98aea8b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:02.537494 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6a115aa3-3761-428a-b449-60e6e3122f8e req-df2d95b9-4939-4b19-82c8-cf4bf98aea8b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 945 time: 0.0565624 Nov 24 16:29:02.589366 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6a115aa3-3761-428a-b449-60e6e3122f8e req-34bf365b-06d7-4061-b4e4-50cd0e48b86e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424705 Nov 24 16:29:03.366238 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:03.440690 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:03.462610 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:03.464840 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ff0a887-4b00-463e-a064-c98a38dcf187" -d '{"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:03.477372 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:03.505105 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69d92e76-b679-4b74-b8c5-439456e3349c x-openstack-request-id: req-69d92e76-b679-4b74-b8c5-439456e3349c {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:03.505450 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:03.505715 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-69d92e76-b679-4b74-b8c5-439456e3349c {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:03.506113 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'code': 200} Nov 24 16:29:03.552821 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:03.600528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=8']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:03.607883 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.608246 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.608598 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.609044 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.609267 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.609630 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.609929 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.610261 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.610596 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.610947 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.611279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.611608 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:03.707992 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b45cb5f-a8d7-4674-851e-9d67c22b4f07 req-d2e0d45a-58a5-4de6-8b76-c2ec297ed030 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:03.709501 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6b45cb5f-a8d7-4674-851e-9d67c22b4f07 req-d2e0d45a-58a5-4de6-8b76-c2ec297ed030 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0481403 Nov 24 16:29:03.755339 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-6b45cb5f-a8d7-4674-851e-9d67c22b4f07 req-d0287c0a-c3ff-4cbb-9aa8-574059103957 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399280 Nov 24 16:29:04.902554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bacffb9-5236-4b32-956c-4fdce94fa164 req-799ae308-4736-47e8-b8e7-42bbeb58dca1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:04.903980 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7bacffb9-5236-4b32-956c-4fdce94fa164 req-799ae308-4736-47e8-b8e7-42bbeb58dca1 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0512438 Nov 24 16:29:04.956601 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7bacffb9-5236-4b32-956c-4fdce94fa164 req-fec3274b-5594-4d61-a485-1d55a95b447c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466666 Nov 24 16:29:06.712675 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-07ca46f3-652a-4e17-b183-758679246b50 req-e68c87a6-e5e9-495a-88a7-2cb7c529416e service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:29:06.713674 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-07ca46f3-652a-4e17-b183-758679246b50 req-e68c87a6-e5e9-495a-88a7-2cb7c529416e service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056427 Nov 24 16:29:06.978622 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ab4e54-5ca5-48d4-b4cb-0c7c1177f0e9 req-95f222b0-a0f6-4768-89f8-aa72ad289cef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:06.980227 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29ab4e54-5ca5-48d4-b4cb-0c7c1177f0e9 req-95f222b0-a0f6-4768-89f8-aa72ad289cef tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0523698 Nov 24 16:29:07.053890 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-29ab4e54-5ca5-48d4-b4cb-0c7c1177f0e9 req-473bb823-cb61-4cd5-a8b9-cdef1292ef1c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449114 Nov 24 16:29:07.300238 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-2d958685-58c2-45c2-ad0d-31fb2420d6ba service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0415180 Nov 24 16:29:08.158079 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655e056e-f686-4c6b-ae74-87d0203d315e req-34a0eabf-1df5-443e-9626-73af86beab19 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:08.159650 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-655e056e-f686-4c6b-ae74-87d0203d315e req-34a0eabf-1df5-443e-9626-73af86beab19 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0553999 Nov 24 16:29:08.206694 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-655e056e-f686-4c6b-ae74-87d0203d315e req-35c46e05-42ce-4049-ae9a-b5f04281d8af tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411162 Nov 24 16:29:09.325579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6150b94-d5e6-4859-a260-f92c8aad2a40 req-94a55ef8-5273-4c70-b502-4c4e3658ff78 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:09.327049 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d6150b94-d5e6-4859-a260-f92c8aad2a40 req-94a55ef8-5273-4c70-b502-4c4e3658ff78 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0501745 Nov 24 16:29:09.363098 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:09.374953 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d6150b94-d5e6-4859-a260-f92c8aad2a40 req-d75937a2-64d4-4cc8-948b-4329203e2e28 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411949 Nov 24 16:29:10.082881 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c57428-5a2d-46be-a874-9895d8715911 req-7ffb1769-aa87-4a2c-9b7e-951691edbe95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.084622 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-7ffb1769-aa87-4a2c-9b7e-951691edbe95 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3&tenant_id=bf09fa482f8a4598be8a0e8428809467 HTTP/1.1" status: 200 len: 1096 time: 0.0420315 Nov 24 16:29:10.151627 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c57428-5a2d-46be-a874-9895d8715911 req-49e61191-a909-4dd7-8cb0-b2e316c72517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.153137 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-49e61191-a909-4dd7-8cb0-b2e316c72517 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1096 time: 0.0415449 Nov 24 16:29:10.253642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c57428-5a2d-46be-a874-9895d8715911 req-9bb3ae92-239d-4f92-b9fe-0fc3a22cbe5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.255475 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-9bb3ae92-239d-4f92-b9fe-0fc3a22cbe5a service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.0938065 Nov 24 16:29:10.329241 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-ee14eb44-b901-4614-898d-7a361651ceba service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 999 time: 0.0646954 Nov 24 16:29:10.384351 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c57428-5a2d-46be-a874-9895d8715911 req-11764e51-fb47-44de-8c8c-353c91b1fdd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.385833 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-11764e51-fb47-44de-8c8c-353c91b1fdd2 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0483720 Nov 24 16:29:10.434735 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c57428-5a2d-46be-a874-9895d8715911 req-5ed37a5c-0b5a-4655-b394-5da761c253e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.436288 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-5ed37a5c-0b5a-4655-b394-5da761c253e5 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422041 Nov 24 16:29:10.559462 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb68916-849a-4899-af93-0c3c69b2d341 req-f22a9c36-053c-43cc-b6ba-dd931aa0ee94 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:10.560983 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ccb68916-849a-4899-af93-0c3c69b2d341 req-f22a9c36-053c-43cc-b6ba-dd931aa0ee94 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.1104815 Nov 24 16:29:10.591657 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-8e999faf-56db-487c-a8e2-59679bab7fca service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1421878 Nov 24 16:29:10.643539 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ccb68916-849a-4899-af93-0c3c69b2d341 req-7a88181f-2a4e-4a9f-bfe0-bce3bfeecc7d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0758183 Nov 24 16:29:10.700196 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d1c57428-5a2d-46be-a874-9895d8715911 req-ebd17be4-a65b-4216-995f-d838a4221bff service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1007986 Nov 24 16:29:11.774406 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d314107c-a355-45f6-8816-b8d30eb3f7fd req-e10ac224-db8a-4f52-9a19-208929a0674f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:11.779386 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d314107c-a355-45f6-8816-b8d30eb3f7fd req-e10ac224-db8a-4f52-9a19-208929a0674f tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0592976 Nov 24 16:29:11.824183 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d314107c-a355-45f6-8816-b8d30eb3f7fd req-cb60f723-41fc-4869-967a-3f78745790f8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422068 Nov 24 16:29:12.947537 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f277c1-a2f5-4ade-a0d8-2389e62bff35 req-f2b37bfc-c566-4d1c-8409-ad6837c817cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:12.949056 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b4f277c1-a2f5-4ade-a0d8-2389e62bff35 req-f2b37bfc-c566-4d1c-8409-ad6837c817cb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0492983 Nov 24 16:29:13.002342 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b4f277c1-a2f5-4ade-a0d8-2389e62bff35 req-a42235cb-d6d5-4c39-ab7e-66c2cd2f5997 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474324 Nov 24 16:29:14.131107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d08e5f-6552-4e67-b0b0-b0797cb516cd req-ea1db337-9db5-4311-ba80-bb1e9e67430a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:14.132628 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-76d08e5f-6552-4e67-b0b0-b0797cb516cd req-ea1db337-9db5-4311-ba80-bb1e9e67430a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0542302 Nov 24 16:29:14.185181 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-76d08e5f-6552-4e67-b0b0-b0797cb516cd req-e4890aef-09ef-40c2-8e58-48a71a9d5783 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463562 Nov 24 16:29:15.308099 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71dba79-421f-428e-9cbf-c52948a587fc req-0e792f7b-e6da-4e23-9905-50b02d60b141 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:15.309499 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b71dba79-421f-428e-9cbf-c52948a587fc req-0e792f7b-e6da-4e23-9905-50b02d60b141 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0497966 Nov 24 16:29:15.362997 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b71dba79-421f-428e-9cbf-c52948a587fc req-7459e6f8-138f-4c5c-9024-bc82f4ccc5a8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470195 Nov 24 16:29:16.496621 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26f791a-62ac-4a3d-8e55-b26692cea46e req-143a51d3-b870-49dd-9967-80bd4a37de9d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:16.501964 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d26f791a-62ac-4a3d-8e55-b26692cea46e req-143a51d3-b870-49dd-9967-80bd4a37de9d tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0549755 Nov 24 16:29:16.557836 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d26f791a-62ac-4a3d-8e55-b26692cea46e req-bcbe4ef8-70a3-4e4d-8251-44d0016d1b25 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537000 Nov 24 16:29:16.939338 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-12a88d44-02be-49f6-915d-072161e5aa39 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:17.678840 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1319e6bc-b59b-4603-955a-e0c81cbb6ae4 req-ce338f4b-dd11-4d31-bcab-2c868b9b56d8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:17.680294 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1319e6bc-b59b-4603-955a-e0c81cbb6ae4 req-ce338f4b-dd11-4d31-bcab-2c868b9b56d8 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0492411 Nov 24 16:29:17.732417 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1319e6bc-b59b-4603-955a-e0c81cbb6ae4 req-0b34f4f1-d406-44f2-bda4-ec824c66750c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457001 Nov 24 16:29:18.858268 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75eb4654-ad14-4ad2-bab0-6c5667f0f115 req-58f93b7e-cf2d-4a6c-9ec7-01c8bc456ffb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:18.859757 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-75eb4654-ad14-4ad2-bab0-6c5667f0f115 req-58f93b7e-cf2d-4a6c-9ec7-01c8bc456ffb tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0519400 Nov 24 16:29:18.909086 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-75eb4654-ad14-4ad2-bab0-6c5667f0f115 req-4ccef535-6b42-45ff-8a1d-e8b85097409a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432000 Nov 24 16:29:19.250346 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e1d194b8-8462-483d-b4c0-b4e65bc02d2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:20.041556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f766bf8b-26d6-4585-8830-7780fc1120f8 req-73813fad-1226-49e5-8c47-d67d01b0c701 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:20.043223 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f766bf8b-26d6-4585-8830-7780fc1120f8 req-73813fad-1226-49e5-8c47-d67d01b0c701 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0528324 Nov 24 16:29:20.092277 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f766bf8b-26d6-4585-8830-7780fc1120f8 req-ecca5ede-df5c-4028-8e44-c18f57f4acfc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431542 Nov 24 16:29:20.358292 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.239668 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53928) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:21.369319 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.400855 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18079130-bb62-4cbb-a482-d8c40e4c2850 req-ad33c12f-8db0-46e8-b2cc-c8c0546dfbdf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:21.404099 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-18079130-bb62-4cbb-a482-d8c40e4c2850 req-ad33c12f-8db0-46e8-b2cc-c8c0546dfbdf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0634723 Nov 24 16:29:21.454711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.458353 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-18079130-bb62-4cbb-a482-d8c40e4c2850 req-92bed8ff-b105-4a34-ac64-e8546789c31e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484343 Nov 24 16:29:21.539229 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.586471 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=057ebd4acffa4b6c94153aaff0e9db77&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3439200 Nov 24 16:29:21.587765 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9756d84b-4a26-44b8-adbb-99437d44c075,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:21.594020 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53932) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:21.595951 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.596511 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.597068 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.597619 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.598147 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.598690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.599243 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.599779 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.600332 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.600854 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.601381 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.601986 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af1b79c5-d9ec-480a-bd9a-635bfbdda9a8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:21.640092 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.667264 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.727573 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.796358 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.799917 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:21.804464 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/9756d84b-4a26-44b8-adbb-99437d44c075 HTTP/1.1" status: 204 len: 168 time: 0.2119710 Nov 24 16:29:21.810101 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb1c553a-4918-4715-af46-afbee0d8aa64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9756d84b-4a26-44b8-adbb-99437d44c075,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:22.452892 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:22.584605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfec5d6f-11c4-49ce-a09c-c5924458cea1 req-d5524303-d5d8-425a-9c28-991b166c3a25 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:22.586130 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cfec5d6f-11c4-49ce-a09c-c5924458cea1 req-d5524303-d5d8-425a-9c28-991b166c3a25 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0489371 Nov 24 16:29:22.637420 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cfec5d6f-11c4-49ce-a09c-c5924458cea1 req-01f845dd-b269-4dac-8cdd-dd3df41b614b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452325 Nov 24 16:29:22.808412 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 53944) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:22.822678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2dfae2ae-e18c-4e0b-aee1-9b100065362b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:22.895221 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2dfae2ae-e18c-4e0b-aee1-9b100065362b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:22.956179 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2dfae2ae-e18c-4e0b-aee1-9b100065362b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:22.996758 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2dfae2ae-e18c-4e0b-aee1-9b100065362b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=43b3ba8e10f54623a79a42e41d0b9557&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1872456 Nov 24 16:29:22.997733 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfae2ae-e18c-4e0b-aee1-9b100065362b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fec3a238-2664-483c-8b0e-6bffeb2c7aa7,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:22.999458 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 53946) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:23.045103 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:23.066050 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:23.167057 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:23.169625 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:23.170850 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/fec3a238-2664-483c-8b0e-6bffeb2c7aa7 HTTP/1.1" status: 204 len: 168 time: 0.1703613 Nov 24 16:29:23.179363 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48f86c6-f501-4d5f-90ea-c2aaede28eae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fec3a238-2664-483c-8b0e-6bffeb2c7aa7,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:23.767604 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a79794-d7c6-4aa4-893c-3c5ab2df0dce req-55ed4f07-e08e-4718-af06-c6e40e7832b3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:23.769973 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b4a79794-d7c6-4aa4-893c-3c5ab2df0dce req-55ed4f07-e08e-4718-af06-c6e40e7832b3 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0561905 Nov 24 16:29:23.818134 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b4a79794-d7c6-4aa4-893c-3c5ab2df0dce req-dbf5a700-2271-4e6b-888f-e457be5c78e9 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429816 Nov 24 16:29:24.939733 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-944105e0-a9b9-49cc-be97-c88b15fa303a req-ba2369f2-144c-4aa4-815d-bb8eabf38edf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:24.941145 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-944105e0-a9b9-49cc-be97-c88b15fa303a req-ba2369f2-144c-4aa4-815d-bb8eabf38edf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 943 time: 0.0501442 Nov 24 16:29:24.989252 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-944105e0-a9b9-49cc-be97-c88b15fa303a req-342cb0f0-717b-44b2-8c2a-34439a0090c0 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420165 Nov 24 16:29:25.399951 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:29:25.502681 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:25.514497 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'port_id': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'mac_address': 'fa:16:3e:9c:d5:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 864, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:29:25.545941 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54018) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:25.554689 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.577846 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:29:25.594091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:25.664883 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d1411a32-2d21-4ba6-a99f-409f2c8139ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.667428 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.718486 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=9']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:25.753288 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d1411a32-2d21-4ba6-a99f-409f2c8139ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.849691 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d1411a32-2d21-4ba6-a99f-409f2c8139ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.892575 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d1411a32-2d21-4ba6-a99f-409f2c8139ff admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=774b842e2c594a2d8fdd0d9b801f8fc2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3454669 Nov 24 16:29:25.895292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54028) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:25.897232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1411a32-2d21-4ba6-a99f-409f2c8139ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1bfa727-25ae-4145-99cf-4b56934f2f3d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:25.911747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:29:25.957649 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:25.983102 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.129623 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09655e65-3011-4115-8d3e-d52156616498 req-234abf64-a137-4f63-8498-4e1157ffe6dc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:26.131235 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-09655e65-3011-4115-8d3e-d52156616498 req-234abf64-a137-4f63-8498-4e1157ffe6dc tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0557184 Nov 24 16:29:26.134763 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63deaef-2df8-46a1-82ed-731b24259dbf req-a2268bc0-061c-4e0c-a5fc-276891e77e9a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:26.136275 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d63deaef-2df8-46a1-82ed-731b24259dbf req-a2268bc0-061c-4e0c-a5fc-276891e77e9a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0572698 Nov 24 16:29:26.137398 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.140134 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.141219 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e1bfa727-25ae-4145-99cf-4b56934f2f3d HTTP/1.1" status: 204 len: 168 time: 0.2448499 Nov 24 16:29:26.159170 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df32489c-e605-498e-b31b-7ac1b92ed290 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1bfa727-25ae-4145-99cf-4b56934f2f3d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:26.207460 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d63deaef-2df8-46a1-82ed-731b24259dbf req-1ef64b47-0ba2-4dd8-a08f-23665df7f787 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623891 Nov 24 16:29:26.211777 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-09655e65-3011-4115-8d3e-d52156616498 req-958b5bff-6c73-4273-9e17-45ca8210470c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0738935 Nov 24 16:29:26.771579 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54038) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:26.785140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a179f239-5a12-4edc-8015-215619a24934 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.856323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a179f239-5a12-4edc-8015-215619a24934 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.944628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a179f239-5a12-4edc-8015-215619a24934 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:26.982743 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a179f239-5a12-4edc-8015-215619a24934 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d396ebb6ba69461db0da956045266b79&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2100606 Nov 24 16:29:26.983653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a179f239-5a12-4edc-8015-215619a24934 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66c5f6dc-5ca6-4b51-bcdc-b37b60ebf972,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:26.986161 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54040) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:27.033013 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.052881 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.158157 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.160822 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.161994 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/66c5f6dc-5ca6-4b51-bcdc-b37b60ebf972 HTTP/1.1" status: 204 len: 168 time: 0.1748416 Nov 24 16:29:27.169799 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb269d1-e73b-4722-ad29-1e279aab57ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66c5f6dc-5ca6-4b51-bcdc-b37b60ebf972,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:27.343075 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cfbacca-fc10-4cb0-ae3b-f38c62002ab5 req-aa89c317-ac9a-4d88-8387-74443527bf9c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:27.343619 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0f27c0-96e2-447f-9661-7bac62d5d74e req-2bec7ac2-ce62-4284-a48e-152759fd0743 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:27.345179 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8cfbacca-fc10-4cb0-ae3b-f38c62002ab5 req-aa89c317-ac9a-4d88-8387-74443527bf9c tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 944 time: 0.0543239 Nov 24 16:29:27.347335 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c0f27c0-96e2-447f-9661-7bac62d5d74e req-2bec7ac2-ce62-4284-a48e-152759fd0743 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0553677 Nov 24 16:29:27.393337 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8cfbacca-fc10-4cb0-ae3b-f38c62002ab5 req-f5da1d80-1f89-41fd-9a02-76666f93ca21 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421972 Nov 24 16:29:27.393549 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c0f27c0-96e2-447f-9661-7bac62d5d74e req-0bb11639-3044-4a22-ae66-3fe7145df04f tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412853 Nov 24 16:29:27.429128 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:29:27.476158 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:29:27.476531 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.552649 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:27.578075 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:27.580362 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb9f45cf-66dc-45f0-b097-6774c6d1e690" -d '{"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:27.593106 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:27.614390 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-add9d9c8-0b18-4724-be3c-335c51ad2628 x-openstack-request-id: req-add9d9c8-0b18-4724-be3c-335c51ad2628 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:27.615081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-plugged", "status": "completed", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:27.615081 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-add9d9c8-0b18-4724-be3c-335c51ad2628 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:27.632899 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'code': 200} Nov 24 16:29:27.912896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310d7649-e709-458c-947e-833962314ad6 req-19db3845-2c03-42ab-be54-7e7ff7a813b1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:27.914250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-310d7649-e709-458c-947e-833962314ad6 req-19db3845-2c03-42ab-be54-7e7ff7a813b1 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0499249 Nov 24 16:29:28.004396 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Deleting port b9e21718-7745-4050-aa02-da6a0542289e {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:28.005080 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.096783 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] For port b9e21718-7745-4050-aa02-da6a0542289e, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=b9e21718-7745-4050-aa02-da6a0542289e,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:28.097149 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.107290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.159913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=10']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:28.271584 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.271979 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.272300 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Floating IP e02968bf-bd62-4956-9f9a-49480333e5a3 disassociated. External IP: 172.27.2.76, port: b9e21718-7745-4050-aa02-da6a0542289e. Nov 24 16:29:28.272644 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Calling delete_port for b9e21718-7745-4050-aa02-da6a0542289e owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:28.382784 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b28e4b-eb97-4553-9aa0-7815074b3618 req-ae60b696-d5ba-4d6b-9da9-9382bee4bdd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:28.384295 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-22b28e4b-eb97-4553-9aa0-7815074b3618 req-ae60b696-d5ba-4d6b-9da9-9382bee4bdd8 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1099 time: 0.0683255 Nov 24 16:29:28.471321 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-22b28e4b-eb97-4553-9aa0-7815074b3618 req-58318097-02d5-4ea1-bafe-de5640f88b7c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0797822 Nov 24 16:29:28.518512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c6afad-d1c0-4a8c-ae3a-16db331648f6 req-f400711b-f6e5-43f1-a7a6-e97a8a3ff55e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:28.520047 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-84c6afad-d1c0-4a8c-ae3a-16db331648f6 req-f400711b-f6e5-43f1-a7a6-e97a8a3ff55e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 945 time: 0.0521414 Nov 24 16:29:28.524652 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d14836-9537-437e-bbdc-63148bcf4c6d req-fb063205-dd01-4db2-9b2c-63de27608a23 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:28.527507 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e5d14836-9537-437e-bbdc-63148bcf4c6d req-fb063205-dd01-4db2-9b2c-63de27608a23 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0551403 Nov 24 16:29:28.529655 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.568668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'Port': ['ID=b9e21718-7745-4050-aa02-da6a0542289e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:28.571379 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-84c6afad-d1c0-4a8c-ae3a-16db331648f6 req-c3db1e51-4828-4fb2-b908-c4b386e739fa tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups?id=6ea77e8f-d594-4451-80ed-ce7f1e9da41d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447052 Nov 24 16:29:28.601869 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.626369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:29:28.662619 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e5d14836-9537-437e-bbdc-63148bcf4c6d req-a70c11fd-724e-4283-a9d3-8a5f6e8cd485 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1261561 Nov 24 16:29:28.737415 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:29:28.842234 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:29:28.852983 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:29:28.864155 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:29:28.864971 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:28.882060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] No DVR routers for this DVR port b9e21718-7745-4050-aa02-da6a0542289e on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:29:28.884778 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:28.888083 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-310d7649-e709-458c-947e-833962314ad6 req-91aa5e26-b5e4-470f-8600-42d8cb66b380 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.84 "DELETE /v2.0/ports/b9e21718-7745-4050-aa02-da6a0542289e HTTP/1.1" status: 204 len: 173 time: 0.9677966 Nov 24 16:29:28.888532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'name': 'network-vif-deleted', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:28.890779 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b9c5f4e-3c2b-4514-9573-b85a75fce01e" -d '{"events": [{"server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "name": "network-vif-deleted", "tag": "b9e21718-7745-4050-aa02-da6a0542289e"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:28.933863 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f985fbe4-77f5-4a02-ae12-949983017e25 x-openstack-request-id: req-f985fbe4-77f5-4a02-ae12-949983017e25 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:28.934370 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c", "name": "network-vif-deleted", "tag": "b9e21718-7745-4050-aa02-da6a0542289e", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:28.934633 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f985fbe4-77f5-4a02-ae12-949983017e25 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:28.935079 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c', 'name': 'network-vif-deleted', 'tag': 'b9e21718-7745-4050-aa02-da6a0542289e', 'status': 'completed', 'code': 200} Nov 24 16:29:29.005615 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:29:29.218185 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:29.347597 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:29.377897 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:29:29.386456 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:29:29.387126 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:29.494606 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:29:29.587971 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54082) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:29.726516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:29.740023 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-aa06890f-f66d-4ecc-8cf0-76231ad85189 req-48c19a28-68a5-4ab9-b03f-812128094e9c tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/ports?device_id=f97ed6fb-b27b-4b9a-b6de-723a9d7ca29c HTTP/1.1" status: 200 len: 210 time: 0.0586400 Nov 24 16:29:29.744216 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8e65441a-0a5a-4bf7-935f-bce3b2704be9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:29.767268 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4373e4b-257d-4f2b-879f-09566283b846 None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:22:29Z', 'revision_number': 4, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '18dfb356-e285-4b88-a549-7d0518916134', 'name': '', 'network_id': '92d9ce23-f297-4622-a4e7-b9b5a8f48b19', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'mac_address': 'fa:16:3e:04:b9:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_interface', 'standard_attr_id': 103, 'fixed_ips': [{'subnet_id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:27Z', 'updated_at': '2021-11-24T16:22:39Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'subnets': [{'id': 'aaaaeafb-6af7-4460-8050-86d8b3b3deb8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:29:29.863124 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d95304f-42a2-4309-b427-240ba9d9d9fa req-d65e2b73-ef26-43c1-bbbc-c57715e94a28 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:29.865760 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0d95304f-42a2-4309-b427-240ba9d9d9fa req-d65e2b73-ef26-43c1-bbbc-c57715e94a28 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0719347 Nov 24 16:29:29.910974 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8e65441a-0a5a-4bf7-935f-bce3b2704be9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:29.936975 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0d95304f-42a2-4309-b427-240ba9d9d9fa req-2c5d2bdc-d043-41b8-8b98-c257e2409adf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656390 Nov 24 16:29:29.975752 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-8e65441a-0a5a-4bf7-935f-bce3b2704be9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.028194 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-8e65441a-0a5a-4bf7-935f-bce3b2704be9 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a5a9f6e0ae91425ebcefee1a544819dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4391203 Nov 24 16:29:30.028931 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e65441a-0a5a-4bf7-935f-bce3b2704be9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=450e4336-8dd2-476d-831c-c5032d9d95e8,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:30.030935 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54108) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:30.055498 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa24f729-c00d-4419-996d-fcd8531c6883 None None] New status for floating IP e02968bf-bd62-4956-9f9a-49480333e5a3: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:29:30.082604 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.104986 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.238369 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.241080 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.244754 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/450e4336-8dd2-476d-831c-c5032d9d95e8 HTTP/1.1" status: 204 len: 168 time: 0.2100849 Nov 24 16:29:30.250232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-042b8deb-a565-4bda-9d91-1b8bc6946411 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=450e4336-8dd2-476d-831c-c5032d9d95e8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:30.888299 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54144) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:30.941683 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:30.965174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.069231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bcf3dfa-9d45-4572-aae3-4c0ea532ddb8 req-ea935233-b88b-4677-b260-4e1d72910ba4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:31.070737 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9bcf3dfa-9d45-4572-aae3-4c0ea532ddb8 req-ea935233-b88b-4677-b260-4e1d72910ba4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0541413 Nov 24 16:29:31.078299 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.082577 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.085392 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54154) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:31.085523 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "DELETE /v2.0/security-groups/6ea77e8f-d594-4451-80ed-ce7f1e9da41d HTTP/1.1" status: 204 len: 168 time: 0.1959643 Nov 24 16:29:31.094320 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c38602-882f-41b6-9f28-92e4183cb30e tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ea77e8f-d594-4451-80ed-ce7f1e9da41d,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:31.109442 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.api.v2.resource [None req-d62a759e-caae-4264-9c0f-c7e118b1d064 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] show failed (client error): The resource could not be found. Nov 24 16:29:31.110542 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d62a759e-caae-4264-9c0f-c7e118b1d064 tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "GET /v2.0/security-groups/6ea77e8f-d594-4451-80ed-ce7f1e9da41d HTTP/1.1" status: 404 len: 347 time: 0.0244398 Nov 24 16:29:31.113782 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54156) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:31.134379 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9bcf3dfa-9d45-4572-aae3-4c0ea532ddb8 req-3f34da19-c7d7-47a7-88e5-8dd9426207bc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576160 Nov 24 16:29:31.432298 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device b9e21718-7745-4050-aa02-da6a0542289e no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:31.452720 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: b9e21718-7745-4050-aa02-da6a0542289e {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:29:31.453069 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device b9e21718-7745-4050-aa02-da6a0542289e not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:29:31.485126 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Deleting port da7a004d-04fa-48fe-bb43-bf00d557ef1b {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:31.485477 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.560225 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.560563 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.573077 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Calling delete_port for da7a004d-04fa-48fe-bb43-bf00d557ef1b owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:31.773442 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.799010 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Pushing event deleted for resources: {'Port': ['ID=da7a004d-04fa-48fe-bb43-bf00d557ef1b,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:31.863460 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.865990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:31.867176 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ed4fec32-449a-4221-99ed-08d68990e0ba tempest-AttachVolumeTestJSON-1937852996 tempest-AttachVolumeTestJSON-1937852996-project] 10.222.0.82 "DELETE /v2.0/floatingips/e02968bf-bd62-4956-9f9a-49480333e5a3 HTTP/1.1" status: 204 len: 168 time: 0.7521663 Nov 24 16:29:32.258460 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f8105e-632a-48be-b642-9c466708cb64 req-0732ba26-c49d-40b5-af3b-9f11b79e9398 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:32.259958 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89f8105e-632a-48be-b642-9c466708cb64 req-0732ba26-c49d-40b5-af3b-9f11b79e9398 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0485966 Nov 24 16:29:32.307489 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89f8105e-632a-48be-b642-9c466708cb64 req-c37f689a-d349-4be8-a5a6-cd652d3d266e tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415289 Nov 24 16:29:33.720127 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96cfaec-6a51-47d4-aa17-6cfa70ca7a58 req-1ed5dc4e-eea3-46fc-83c0-3ce2bf01f644 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:33.721601 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a96cfaec-6a51-47d4-aa17-6cfa70ca7a58 req-1ed5dc4e-eea3-46fc-83c0-3ce2bf01f644 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0529170 Nov 24 16:29:33.770112 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a96cfaec-6a51-47d4-aa17-6cfa70ca7a58 req-12ffb723-ac58-49a4-8e24-3d4640e84e91 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424547 Nov 24 16:29:34.631586 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-71a470d2-9f18-4eee-8fb8-c0da3f388cc3 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384679 Nov 24 16:29:34.691683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636051fe-3374-48a7-b60b-8d070aa62957 req-6e940bfc-ab7a-47ec-a10f-33208fbd36b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:34.693148 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-6e940bfc-ab7a-47ec-a10f-33208fbd36b3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=bf09fa482f8a4598be8a0e8428809467&device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 1099 time: 0.0390821 Nov 24 16:29:34.815519 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636051fe-3374-48a7-b60b-8d070aa62957 req-7c2bdd15-2b86-474e-a8bf-9a8722c49224 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:34.817014 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-7c2bdd15-2b86-474e-a8bf-9a8722c49224 service neutron] 10.222.0.84 "GET /v2.0/networks?id=32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 200 len: 918 time: 0.1042039 Nov 24 16:29:34.915188 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-e4ea55a2-9cc3-4e36-a929-4ed5520a7888 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 200 len: 1001 time: 0.0906534 Nov 24 16:29:34.927718 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848d91a9-7b09-48f2-92b7-42042b367b2a req-4acb34dc-db7d-4ed9-ae8f-a04d9584c912 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:34.929115 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-848d91a9-7b09-48f2-92b7-42042b367b2a req-4acb34dc-db7d-4ed9-ae8f-a04d9584c912 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0701065 Nov 24 16:29:34.998169 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636051fe-3374-48a7-b60b-8d070aa62957 req-c2de30c5-591e-4134-9580-5218c82ac8a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:34.999641 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-c2de30c5-591e-4134-9580-5218c82ac8a1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 200 len: 856 time: 0.0696905 Nov 24 16:29:35.014025 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-848d91a9-7b09-48f2-92b7-42042b367b2a req-4dbce416-bc28-473d-b768-d93d442a9fb7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759468 Nov 24 16:29:35.056680 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636051fe-3374-48a7-b60b-8d070aa62957 req-f4e4028e-1783-4b04-a4e8-ea594d38c3b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:35.058200 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-f4e4028e-1783-4b04-a4e8-ea594d38c3b3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=32d52469-d493-4e5e-ad0f-a328c47ce499&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433335 Nov 24 16:29:35.148315 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-f34f9f2a-cdee-433c-bafe-536c37731e8c service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812075 Nov 24 16:29:35.266669 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-636051fe-3374-48a7-b60b-8d070aa62957 req-030d07e9-9f4f-4743-a70d-249de20fd038 service neutron] 10.222.0.84 "GET /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901072 Nov 24 16:29:35.622347 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54226) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:35.730067 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-014504f5-48c1-4ed3-93e5-091c72e0a91b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:35.802085 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-014504f5-48c1-4ed3-93e5-091c72e0a91b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:35.871599 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54236) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:35.909982 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-014504f5-48c1-4ed3-93e5-091c72e0a91b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:35.987353 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-014504f5-48c1-4ed3-93e5-091c72e0a91b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8858c5223c364d60a18d88451ed03f81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3638637 Nov 24 16:29:35.990054 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54240) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:35.994218 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014504f5-48c1-4ed3-93e5-091c72e0a91b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8de1bc8-dbde-4696-8467-a5f17760eaf2,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:36.040199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.061718 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.175325 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.177989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.179160 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/d8de1bc8-dbde-4696-8467-a5f17760eaf2 HTTP/1.1" status: 204 len: 168 time: 0.1880867 Nov 24 16:29:36.183344 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d68d46e-3213-4140-94c4-cb66ac5e1883 req-b86612c9-a0ea-4723-9bc2-38de8207c2ef tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:36.184301 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d68d46e-3213-4140-94c4-cb66ac5e1883 req-b86612c9-a0ea-4723-9bc2-38de8207c2ef tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0955706 Nov 24 16:29:36.187816 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f133b032-5d9b-464f-a5f8-e237c76f108d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8de1bc8-dbde-4696-8467-a5f17760eaf2,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:36.291641 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d68d46e-3213-4140-94c4-cb66ac5e1883 req-b018a09b-29a8-48ee-81d8-a2da2f92dfb7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0964313 Nov 24 16:29:36.372208 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.621184 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Deleting port 18dfb356-e285-4b88-a549-7d0518916134 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:36.621441 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.698059 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] For port 18dfb356-e285-4b88-a549-7d0518916134, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=18dfb356-e285-4b88-a549-7d0518916134,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:36.698730 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.714483 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Calling delete_port for 18dfb356-e285-4b88-a549-7d0518916134 owned by network:router_interface {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:36.737877 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54248) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:36.751589 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-244ebe15-cc76-41fc-9212-c5055003abaa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.824648 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-244ebe15-cc76-41fc-9212-c5055003abaa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.887933 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-244ebe15-cc76-41fc-9212-c5055003abaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:36.928464 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-244ebe15-cc76-41fc-9212-c5055003abaa admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=a9fd5c694479403fa0192d3c3b584fe3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1894565 Nov 24 16:29:36.929578 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244ebe15-cc76-41fc-9212-c5055003abaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8eed976-854e-46dd-90d0-3396976772d7,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:36.931126 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54250) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:36.974242 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.011932 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Pushing event deleted for resources: {'Port': ['ID=18dfb356-e285-4b88-a549-7d0518916134,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:37.031785 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.081181 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.214964 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.259913 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.262464 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.263654 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f8eed976-854e-46dd-90d0-3396976772d7 HTTP/1.1" status: 204 len: 168 time: 0.3314734 Nov 24 16:29:37.279076 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f0f401-828b-4214-8f73-d2a6d498d8de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8eed976-854e-46dd-90d0-3396976772d7,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:37.414774 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05afd16-00ea-4e1c-bdef-252bad2f94d9 req-7efa14e3-5989-4fed-ae03-426366af1bef tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:37.416228 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f05afd16-00ea-4e1c-bdef-252bad2f94d9 req-7efa14e3-5989-4fed-ae03-426366af1bef tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0487168 Nov 24 16:29:37.454558 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Router 8c1be576-3043-4dba-941b-81d9ad17cae0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:29:37.466089 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f05afd16-00ea-4e1c-bdef-252bad2f94d9 req-5d396028-fc86-4cb7-bee4-235c5507792d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439293 Nov 24 16:29:37.562472 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:29:37.570478 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-232dc500-3a6a-42dd-93b7-07180d1a0e5e admin admin] 10.222.0.82 "PUT /v2.0/routers/8c1be576-3043-4dba-941b-81d9ad17cae0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6952863 Nov 24 16:29:37.570991 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54258) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:37.577266 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Sync routers for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:29:37.587681 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:29:37.592828 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:37.690081 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks [] for router, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.725431 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:29:37.801400 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:37.905718 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176'}], 'enable_snat': True}, 'gw_port_id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:29:36Z', 'revision_number': 5, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port': {'id': '73d4ea20-e85e-4a14-86b5-e0d5e6335e61', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:d8:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:22Z', 'updated_at': '2021-11-24T16:22:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:37.933542 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Checking router: 8c1be576-3043-4dba-941b-81d9ad17cae0 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:29:37.941241 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Routers {'8c1be576-3043-4dba-941b-81d9ad17cae0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:29:37.941857 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['8c1be576-3043-4dba-941b-81d9ad17cae0'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:37.950085 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Deleting port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:37.950731 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.033165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] Set router 8c1be576-3043-4dba-941b-81d9ad17cae0 gateway port host: None {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:29:38.040840 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] For port 73d4ea20-e85e-4a14-86b5-e0d5e6335e61, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:38.041251 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.054130 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Calling delete_port for 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 owned by network:router_gateway {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:38.092068 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:29:37Z', 'revision_number': 6, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:38.119121 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b74cd993-32c8-4425-84fe-20834b7d00ae None None] The sync data for ids ['8c1be576-3043-4dba-941b-81d9ad17cae0'] in dv-cinder-819007-2-iscsi is: [{'id': '8c1be576-3043-4dba-941b-81d9ad17cae0', 'name': 'tempest-AttachVolumeTestJSON-112565635-router', 'tenant_id': 'b96983a681284ac1a3cb8640a9c716cd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:21Z', 'updated_at': '2021-11-24T16:29:37Z', 'revision_number': 6, 'project_id': 'b96983a681284ac1a3cb8640a9c716cd', 'gw_port_host': None}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:29:38.152210 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:29:38.298800 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.325942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Pushing event deleted for resources: {'Port': ['ID=73d4ea20-e85e-4a14-86b5-e0d5e6335e61,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:38.378284 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54276) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:38.394599 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.485941 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1543230598-network', 'tenant_id': 'b78073210f024b99bff80573db460e63'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:29:38.494953 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.498290 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.591123 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81cf2be0-fc0f-4fc5-998e-ee304a45e0a2 req-4572f7e3-db88-4ccb-acc0-bcaa55b847cd tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:38.592698 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-81cf2be0-fc0f-4fc5-998e-ee304a45e0a2 req-4572f7e3-db88-4ccb-acc0-bcaa55b847cd tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0514183 Nov 24 16:29:38.640616 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-81cf2be0-fc0f-4fc5-998e-ee304a45e0a2 req-559d77b4-28e0-4cf1-ab0b-e4f7e6e00960 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418794 Nov 24 16:29:38.647035 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Made reservation on behalf of b78073210f024b99bff80573db460e63 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:29:38.649523 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.662353 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.722279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.722279 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8c1be576-3043-4dba-941b-81d9ad17cae0 {{(pid=103141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:29:38.728427 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.729552 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-25b589b3-a419-441f-955e-1a4518e0f8bb admin admin] 10.222.0.82 "DELETE /v2.0/routers/8c1be576-3043-4dba-941b-81d9ad17cae0 HTTP/1.1" status: 204 len: 168 time: 1.1579149 Nov 24 16:29:38.732197 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54282) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:38.741560 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.780273 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Deleting subnet aaaaeafb-6af7-4460-8050-86d8b3b3deb8 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:29:38.783388 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.815606 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.822032 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.837033 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:29:38.850782 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1efeee94-1091-4fc0-b605-570d1ca2e79d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:38.855844 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.856796 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Added segment 79f9c45b-d625-445a-8047-aa0cc0f0c275 of type vlan for network 1650620c-7a8c-431a-a9ce-7391af17c333 Nov 24 16:29:38.903812 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.990293 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:38.991321 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:38.991926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.054742 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] Pushing event updated for resources: {'Network': ['ID=1650620c-7a8c-431a-a9ce-7391af17c333,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:39.064957 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 1650620c-7a8c-431a-a9ce-7391af17c333 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:29:39.108858 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-77f0c3ae-c300-4991-a409-e00a4a8f7a6a admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.7256763 Nov 24 16:29:39.108858 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54284) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:39.116827 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Request body: {'subnet': {'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1543230598-subnet', 'tenant_id': 'b78073210f024b99bff80573db460e63', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:29:39.177083 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.213742 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Made reservation on behalf of b78073210f024b99bff80573db460e63 for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:29:39.215329 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.299011 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.325543 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aaaaeafb-6af7-4460-8050-86d8b3b3deb8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:39.327701 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.331287 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d5aa6875-8e11-4c42-a960-20648020e752 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/aaaaeafb-6af7-4460-8050-86d8b3b3deb8 HTTP/1.1" status: 204 len: 168 time: 0.5980513 Nov 24 16:29:39.340079 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-292043c2-03c2-468d-9e35-014e49679a11 None None] Network 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:29:39.340890 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54286) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:39.403759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.459040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Deleting port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:39.459409 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.467281 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.521194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] DHCP port deletion for 92d9ce23-f297-4622-a4e7-b9b5a8f48b19 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:29:39.528955 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Pushing event updated for resources: {'Subnet': ['ID=62ccada2-06b7-48ef-aa7b-a32da4df289e,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:39.537668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] For port f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:39.541027 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.547892 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Checking segment: {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:29:39.548509 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Network hostable DHCP agents. Network: 1650620c-7a8c-431a-a9ce-7391af17c333, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:29:39.551982 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Calling delete_port for f5cab198-4c84-4ca1-b4e3-c018dcb416f6 owned by network:dhcp {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:39.583318 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Deleting port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:39.583688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.649854 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] For port f5cab198-4c84-4ca1-b4e3-c018dcb416f6, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,segment=NetworkSegment(069d1d08-3607-440c-b8cc-fd16cb843e41),segment_id=069d1d08-3607-440c-b8cc-fd16cb843e41)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:39.649854 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.658795 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Calling delete_port for f5cab198-4c84-4ca1-b4e3-c018dcb416f6 owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:39.668586 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Network 1650620c-7a8c-431a-a9ce-7391af17c333 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:29:39.693041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.711604 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:39.723526 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Pushing event deleted for resources: {'Port': ['ID=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:39.732155 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] No DVR routers for this DVR port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 on host dv-cinder-819007-2-iscsi {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:29:39.738023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:29:39.738298 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 73d4ea20-e85e-4a14-86b5-e0d5e6335e61 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:29:39.738706 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 18dfb356-e285-4b88-a549-7d0518916134 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:39.749936 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 1650620c-7a8c-431a-a9ce-7391af17c333) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:29:39.759064 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:39.762114 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.767543 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c599525-5490-464b-a7fd-33061c4be71f None None] Network 1650620c-7a8c-431a-a9ce-7391af17c333 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:29:39.771493 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 18dfb356-e285-4b88-a549-7d0518916134 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:29:39.771881 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 18dfb356-e285-4b88-a549-7d0518916134 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:29:39.772897 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device f5cab198-4c84-4ca1-b4e3-c018dcb416f6 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:39.815367 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: f5cab198-4c84-4ca1-b4e3-c018dcb416f6 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:29:39.815635 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device f5cab198-4c84-4ca1-b4e3-c018dcb416f6 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:29:39.831725 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.839302 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7cb4f6ce-a333-407e-a502-0cfe155e1a6d admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7275794 Nov 24 16:29:39.841119 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321e631b-845f-4059-88da-8e7062b61b0b req-b5fa1c27-12e6-44fb-bb9a-eb7accf15234 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:39.842632 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-321e631b-845f-4059-88da-8e7062b61b0b req-b5fa1c27-12e6-44fb-bb9a-eb7accf15234 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.1222100 Nov 24 16:29:39.866562 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.875246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['92d9ce23-f297-4622-a4e7-b9b5a8f48b19']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:39.889865 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '069d1d08-3607-440c-b8cc-fd16cb843e41') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:39.890064 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '069d1d08-3607-440c-b8cc-fd16cb843e41') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:29:39.902768 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] Pushing event deleted for resources: {'Port': ['ID=f5cab198-4c84-4ca1-b4e3-c018dcb416f6,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:39.907240 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.912583 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-264ff9bf-0ffc-4fcb-8061-217bf3ab8eb8 None None] No DVR routers for this DVR port f5cab198-4c84-4ca1-b4e3-c018dcb416f6 on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:29:39.941111 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-321e631b-845f-4059-88da-8e7062b61b0b req-15262e70-321f-44f9-9102-105259c54061 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0898290 Nov 24 16:29:39.942391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.949160 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Releasing vlan 858 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:29:39.966478 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:29:39.973304 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b22b2ad-66ca-448c-acec-fae75010881c None None] Network 1650620c-7a8c-431a-a9ce-7391af17c333 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:29:40.090296 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.106420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.110452 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] 10.222.0.82 "DELETE /v2.0/networks/92d9ce23-f297-4622-a4e7-b9b5a8f48b19 HTTP/1.1" status: 204 len: 168 time: 0.7750862 Nov 24 16:29:40.111373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ab3eed-825c-44a3-9e44-0fa2fb5ddfb4 admin admin] Pushing event deleted for resources: {'Network': ['ID=92d9ce23-f297-4622-a4e7-b9b5a8f48b19,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:40.414585 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54298) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:40.453195 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c5042439-efc3-433b-bde8-c75a7c60d5c1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b96983a681284ac1a3cb8640a9c716cd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0374589 Nov 24 16:29:40.455511 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54300) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:40.501080 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.520936 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.643736 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.646433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:40.647641 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/4b84f523-bf0f-415a-ba10-8a19cf805fec HTTP/1.1" status: 204 len: 168 time: 0.1912534 Nov 24 16:29:40.655921 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca02b09e-c0aa-410d-b39e-3367409ba2e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b84f523-bf0f-415a-ba10-8a19cf805fec,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:41.063163 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe50028c-e14e-474d-8877-129fdc698db7 req-c053b040-7f53-4190-80c9-a86a2838fcbd tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:41.064697 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fe50028c-e14e-474d-8877-129fdc698db7 req-c053b040-7f53-4190-80c9-a86a2838fcbd tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0531919 Nov 24 16:29:41.124616 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-fe50028c-e14e-474d-8877-129fdc698db7 req-f81bd73c-6ab0-4163-9778-90db61576757 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499859 Nov 24 16:29:42.154267 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-bd40c2cd-173d-4c94-8bcb-1448413ad163 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:42.155810 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-bd40c2cd-173d-4c94-8bcb-1448413ad163 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/networks?id=1650620c-7a8c-431a-a9ce-7391af17c333 HTTP/1.1" status: 200 len: 809 time: 0.1087873 Nov 24 16:29:42.170954 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-ca04cb9f-74ef-42b1-90c4-18a645f2e3a5 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/quotas/b78073210f024b99bff80573db460e63 HTTP/1.1" status: 200 len: 375 time: 0.0094242 Nov 24 16:29:42.209659 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-027e67df-0aac-40f2-a2e5-44fdf1233a92 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0317709 Nov 24 16:29:42.246897 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbdc3a0-aac6-4865-8e7f-8db98d17d4f6 req-d7fe4ce6-94c8-4863-bd2b-bd10f2fb1820 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:42.248337 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8dbdc3a0-aac6-4865-8e7f-8db98d17d4f6 req-d7fe4ce6-94c8-4863-bd2b-bd10f2fb1820 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0544682 Nov 24 16:29:42.323462 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8dbdc3a0-aac6-4865-8e7f-8db98d17d4f6 req-3c72fcae-efca-42e2-a36b-e78a4b23046e tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550687 Nov 24 16:29:42.323572 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-3e4982f7-aad2-45ec-b8a3-7dc2f3ad37ce service neutron] 10.222.0.82 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966048 Nov 24 16:29:42.406687 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-2bd6db55-6197-4f53-a6e0-3ffaa02b5ad3 service neutron] 10.222.0.82 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891795 Nov 24 16:29:42.639028 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ad4c9314-7937-4f8e-966f-fbca2dcca03c req-7e49c20d-8d77-4183-9259-ab4a7f50c23a tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 210 time: 0.0398221 Nov 24 16:29:43.429696 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7c5b31-8aa6-4c4d-b939-ff3143c2467c req-27661dff-875f-49dc-91f4-2bacc8ad4d4d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:43.431216 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-eb7c5b31-8aa6-4c4d-b939-ff3143c2467c req-27661dff-875f-49dc-91f4-2bacc8ad4d4d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0509315 Nov 24 16:29:43.480663 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-eb7c5b31-8aa6-4c4d-b939-ff3143c2467c req-1fb78d00-0760-4812-ab31-c59649f693df tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434530 Nov 24 16:29:43.723967 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-41d76bed-7797-49e6-8ead-98ca574d3d6d req-bc153ec8-0ec2-4c8e-91f1-7b9419c3c274 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 210 time: 0.0261354 Nov 24 16:29:44.597830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d28f772b-3b20-4d58-9386-df3a1b12a2a4 req-7125303b-9061-475a-958c-13f8f9a3c34a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:44.599305 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d28f772b-3b20-4d58-9386-df3a1b12a2a4 req-7125303b-9061-475a-958c-13f8f9a3c34a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0498099 Nov 24 16:29:44.719019 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d28f772b-3b20-4d58-9386-df3a1b12a2a4 req-5de2c94e-d559-45f4-8b27-8831864ade8b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1040299 Nov 24 16:29:44.778934 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-dcbc0a95-6900-4a3f-baf4-becb4e53136f tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:44.780454 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-dcbc0a95-6900-4a3f-baf4-becb4e53136f tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "GET /v2.0/networks?id=1650620c-7a8c-431a-a9ce-7391af17c333 HTTP/1.1" status: 200 len: 809 time: 0.1510448 Nov 24 16:29:44.803488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Request body: {'port': {'device_id': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333', 'admin_state_up': True, 'tenant_id': 'b78073210f024b99bff80573db460e63'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:29:44.850005 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-e291413c-0566-42f7-8cf6-59506f01ee0d req-254f8e2b-147f-4aa1-be1f-b6c4f8734975 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 210 time: 0.0335946 Nov 24 16:29:45.003971 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Made reservation on behalf of b78073210f024b99bff80573db460e63 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:29:45.007576 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:45.134568 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Allocated IP 172.20.0.14 (1650620c-7a8c-431a-a9ce-7391af17c333/62ccada2-06b7-48ef-aa7b-a32da4df289e/7e7bd72f-ede8-4b88-95d5-c07a27aac1c0) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:29:45.285643 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:45.387765 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:45.433612 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Network 1650620c-7a8c-431a-a9ce-7391af17c333 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:29:45.436587 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:29:45.440856 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:29:45.468488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Pushing event updated for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:45.497019 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:45.500437 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:45.629338 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-161f69ab-eaf6-435a-a4a7-cb46ff0732de tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8371403 Nov 24 16:29:45.653928 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Request body: {'port': {'device_id': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:29:45.707001 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:45.889960 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c3a9781-e267-46b4-a58c-0903800982d3 req-a93a0e51-90be-4081-9471-e188284e6fb9 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:45.891520 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c3a9781-e267-46b4-a58c-0903800982d3 req-a93a0e51-90be-4081-9471-e188284e6fb9 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0828791 Nov 24 16:29:45.966212 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a389290f-76b8-4191-b5eb-8d17db991381 req-addddaed-5fd9-45f0-a87d-445740266a8b tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:45.967747 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a389290f-76b8-4191-b5eb-8d17db991381 req-addddaed-5fd9-45f0-a87d-445740266a8b tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 932 time: 0.0480051 Nov 24 16:29:45.991474 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3c3a9781-e267-46b4-a58c-0903800982d3 req-31b39821-229a-4822-abcb-3a5272253dac tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0732391 Nov 24 16:29:46.022445 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a389290f-76b8-4191-b5eb-8d17db991381 req-d8fa9272-4f0c-4538-8008-0a19943599e9 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481889 Nov 24 16:29:46.047140 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:29:46.054763 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.066275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Transition to ACTIVE for port object 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:29:46.127043 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.176961 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Pushing event updated for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:46.245557 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Attempting to bind port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:29:46.245893 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Attempting to bind port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:29:46.246225 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Attempting to bind port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 on network 1650620c-7a8c-431a-a9ce-7391af17c333 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:29:46.250463 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 on network 1650620c-7a8c-431a-a9ce-7391af17c333 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:29:46.250783 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Attempting to bind port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 on network 1650620c-7a8c-431a-a9ce-7391af17c333 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:29:46.255644 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 29, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:29:46.255983 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Checking segment: {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:29:46.256370 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Bound using segment: {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:29:46.256804 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Bound port: 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:29:46.257155 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.318984 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:29:46.321956 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:29:46.403789 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.437767 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.438933 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.440420 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] 10.222.0.84 "PUT /v2.0/ports/7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 HTTP/1.1" status: 200 len: 1094 time: 0.7905629 Nov 24 16:29:46.440772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:46.443038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a37b1071-3f6a-4d50-83af-96959a8c88cb" -d '{"events": [{"name": "network-changed", "server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:46.479728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a7c74b-938d-4946-abfb-dcf48d05312d service neutron] Pushing event updated for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:46.485814 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f9c6b3b-c05a-49c2-aa55-b4c310b57a73 x-openstack-request-id: req-6f9c6b3b-c05a-49c2-aa55-b4c310b57a73 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:46.485814 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:46.485814 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6f9c6b3b-c05a-49c2-aa55-b4c310b57a73 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:46.485814 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0', 'status': 'completed', 'code': 200} Nov 24 16:29:46.551745 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-b618916d-f732-4b08-a535-b583c3dbc0f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.553250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-b618916d-f732-4b08-a535-b583c3dbc0f8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 1097 time: 0.0415916 Nov 24 16:29:46.657146 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-5e1b3080-1367-4b4e-8a6b-af522b31d778 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.658620 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-5e1b3080-1367-4b4e-8a6b-af522b31d778 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=b78073210f024b99bff80573db460e63&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0967672 Nov 24 16:29:46.757850 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-7ac7325e-ac3c-4c0b-9ec7-d0c0061f56b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.759347 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a37b1071-3f6a-4d50-83af-96959a8c88cb req-7ac7325e-ac3c-4c0b-9ec7-d0c0061f56b3 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0926011 Nov 24 16:29:46.837226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-9afedd40-ff2e-495e-a089-217bd87c3432 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.838727 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-9afedd40-ff2e-495e-a089-217bd87c3432 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 1097 time: 0.0423732 Nov 24 16:29:46.885819 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-e3f5cf6c-9b64-4e9d-94a2-b3fc8e154618 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 HTTP/1.1" status: 200 len: 217 time: 0.0371635 Nov 24 16:29:46.918722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c04c9ed2-96ef-42e8-99a0-632f7eff3e58 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:46.936844 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-aff3668d-a945-433a-88ba-3cc8de2f342d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:46.939007 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-aff3668d-a945-433a-88ba-3cc8de2f342d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=62ccada2-06b7-48ef-aa7b-a32da4df289e HTTP/1.1" status: 200 len: 849 time: 0.0447681 Nov 24 16:29:46.973536 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-52a05c65-2e05-4dfc-a312-2c4de765a1c8 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=1650620c-7a8c-431a-a9ce-7391af17c333&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0280478 Nov 24 16:29:47.067840 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-87a49178-fa5a-4c68-819a-b0416ec8d7ab service neutron] 10.222.0.84 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865519 Nov 24 16:29:47.117909 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2619cf36-1e0e-436c-8a85-d8f3b41b433f req-ce6f52d3-1ce1-4c3c-a524-216cf44543c2 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:47.119432 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2619cf36-1e0e-436c-8a85-d8f3b41b433f req-ce6f52d3-1ce1-4c3c-a524-216cf44543c2 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0596321 Nov 24 16:29:47.169299 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2619cf36-1e0e-436c-8a85-d8f3b41b433f req-b4d365d3-1f96-4d5d-8803-8d7055acfa2b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436063 Nov 24 16:29:47.205218 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7eacdf-ac5d-4a7a-bae5-a5ed1186c93a req-da33f727-8153-4466-8cca-9d44295193b8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:47.207064 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9c7eacdf-ac5d-4a7a-bae5-a5ed1186c93a req-da33f727-8153-4466-8cca-9d44295193b8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 944 time: 0.1121700 Nov 24 16:29:47.229610 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93bdcc33-5556-4b89-ad07-ef046c709e63 req-d434e827-cc0f-4e71-9b30-0dd0db5fb24d service neutron] 10.222.0.84 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1533563 Nov 24 16:29:47.260262 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9c7eacdf-ac5d-4a7a-bae5-a5ed1186c93a req-a27f1f64-76b7-4987-90ab-ec14a4588e4a tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475862 Nov 24 16:29:48.044269 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54448) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:48.150736 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea6015cf-e9d7-457b-b1de-ef12dbafb37f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.225769 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea6015cf-e9d7-457b-b1de-ef12dbafb37f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.285199 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920738d5-f8c3-4289-b4e6-8923b9b0be38 req-c5e8324f-17a7-41db-bd85-eff97ca5455b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:48.286674 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-920738d5-f8c3-4289-b4e6-8923b9b0be38 req-c5e8324f-17a7-41db-bd85-eff97ca5455b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0467494 Nov 24 16:29:48.301146 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea6015cf-e9d7-457b-b1de-ef12dbafb37f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.338047 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-920738d5-f8c3-4289-b4e6-8923b9b0be38 req-6dabaf4f-c393-4098-a645-3401c2c05859 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451975 Nov 24 16:29:48.347841 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6015cf-e9d7-457b-b1de-ef12dbafb37f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3bbccdbf-a9bf-42d2-bc72-85e38ffbadfa,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:48.354573 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-ea6015cf-e9d7-457b-b1de-ef12dbafb37f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bf4cf4761d4d4f6cb7b960a51dfe551b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3069751 Nov 24 16:29:48.359338 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54456) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:48.389177 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fa6e11-9cb1-45b0-a889-4dbe898f2dd1 req-1daf8ead-4c15-4717-b0dd-583528af8116 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:48.390564 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-32fa6e11-9cb1-45b0-a889-4dbe898f2dd1 req-1daf8ead-4c15-4717-b0dd-583528af8116 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 944 time: 0.0564179 Nov 24 16:29:48.406815 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.431308 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.447803 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-32fa6e11-9cb1-45b0-a889-4dbe898f2dd1 req-bfa46852-b8f7-4559-8ac1-b037aade5c9f tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509038 Nov 24 16:29:48.552296 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.555042 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:48.556194 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/3bbccdbf-a9bf-42d2-bc72-85e38ffbadfa HTTP/1.1" status: 204 len: 168 time: 0.1954238 Nov 24 16:29:48.564607 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63cb80c-d496-4c6a-a021-5ebd749b6cd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3bbccdbf-a9bf-42d2-bc72-85e38ffbadfa,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:49.001685 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-fe3db2ce-b10c-4170-b9af-8ac5f1ef8f14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.003111 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-fe3db2ce-b10c-4170-b9af-8ac5f1ef8f14 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.0409241 Nov 24 16:29:49.096774 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-770c7c01-196d-41bb-826c-9c3c2ec66856 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.098365 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-770c7c01-196d-41bb-826c-9c3c2ec66856 service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.0867772 Nov 24 16:29:49.163245 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-8df4f68f-2cf9-4beb-ad93-5b476d31c250 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 1001 time: 0.0573637 Nov 24 16:29:49.217010 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-8a8ad1a8-b41b-4c0a-9068-f6bcc6bff1c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.219150 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-8a8ad1a8-b41b-4c0a-9068-f6bcc6bff1c0 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.0479572 Nov 24 16:29:49.219938 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54462) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:49.240612 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-605d41cf-7d32-43d9-80f5-6b0d5b464ef0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.255003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-7bee045f-d803-4aa5-a739-cb0fbe75b863 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.290640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-c3671d9b-8b46-4ece-9f4c-04c5e91f7882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.292185 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-c3671d9b-8b46-4ece-9f4c-04c5e91f7882 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0655208 Nov 24 16:29:49.404205 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-605d41cf-7d32-43d9-80f5-6b0d5b464ef0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.420103 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-54d03a00-7cb8-4a78-9d3f-f2fd385ef3aa service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1164894 Nov 24 16:29:49.453313 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a290d864-2ffa-4e97-bdfa-965f0682e130 req-4ba4270f-5a88-4f7d-b8d2-b398603fcc8f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.455484 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a290d864-2ffa-4e97-bdfa-965f0682e130 req-4ba4270f-5a88-4f7d-b8d2-b398603fcc8f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0507483 Nov 24 16:29:49.483804 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-605d41cf-7d32-43d9-80f5-6b0d5b464ef0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.507035 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a290d864-2ffa-4e97-bdfa-965f0682e130 req-04cbe5fe-a019-45e0-8e8f-f6a3a29a5c0c tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454566 Nov 24 16:29:49.508084 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:29:49.554958 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-605d41cf-7d32-43d9-80f5-6b0d5b464ef0 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=defac42d2ae749aa9503130a1b646a4b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3323579 Nov 24 16:29:49.556220 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54468) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:29:49.561331 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605d41cf-7d32-43d9-80f5-6b0d5b464ef0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37d5a091-522c-4378-99ff-abdb6d736978,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:49.567770 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-540ef901-dc2e-48fb-beb8-b7209cc0fbe6 req-4dbf2bef-b7af-4080-98e4-a652301baeeb service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1399863 Nov 24 16:29:49.608771 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3ee171-b907-44b8-91f6-6fad445f6416 req-0f583e3d-a9ba-4e0a-92ba-1c9c0e2b3623 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:49.610900 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-de3ee171-b907-44b8-91f6-6fad445f6416 req-0f583e3d-a9ba-4e0a-92ba-1c9c0e2b3623 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 944 time: 0.0625250 Nov 24 16:29:49.623926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.647259 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.663765 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-de3ee171-b907-44b8-91f6-6fad445f6416 req-53f31ca4-1470-4335-85f7-48c07e108c67 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458903 Nov 24 16:29:49.763707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:49.774876 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0', 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333', 'port_id': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0', 'mac_address': 'fa:16:3e:a2:cd:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 896, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62ccada2-06b7-48ef-aa7b-a32da4df289e', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:29:49.775044 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.777819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.779072 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/37d5a091-522c-4378-99ff-abdb6d736978 HTTP/1.1" status: 204 len: 168 time: 0.2218027 Nov 24 16:29:49.787973 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67cb1a43-f059-486f-a10b-ddb11a98c5b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37d5a091-522c-4378-99ff-abdb6d736978,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:49.827010 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.840378 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:29:49.866493 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:49.912174 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:49.959112 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:50.153314 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['7e7bd72f-ede8-4b88-95d5-c07a27aac1c0'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:29:50.401042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:50.623980 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf4a1b3-fc1c-4911-a557-1f695335d404 req-5515c66b-c5d6-4476-8341-78f112abaa05 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:50.626092 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7bf4a1b3-fc1c-4911-a557-1f695335d404 req-5515c66b-c5d6-4476-8341-78f112abaa05 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0493369 Nov 24 16:29:50.674448 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7bf4a1b3-fc1c-4911-a557-1f695335d404 req-27a2d45a-2250-42ea-904c-00c72e5bee9b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426028 Nov 24 16:29:50.782762 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1750f3-a511-4150-b5c7-3ace801e9fbe req-449dc35f-56c7-4679-a184-235080b2a2fb tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:50.784288 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ea1750f3-a511-4150-b5c7-3ace801e9fbe req-449dc35f-56c7-4679-a184-235080b2a2fb tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 945 time: 0.0534639 Nov 24 16:29:50.833342 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ea1750f3-a511-4150-b5c7-3ace801e9fbe req-e416b338-33b1-452e-8009-1e6117cac14d tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427766 Nov 24 16:29:51.525439 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:29:51.637986 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:29:51.642942 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:29:51.643320 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:51.741434 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:51.767330 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:51.769625 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad6f9e6a-86c3-4c29-9084-6c9726ed2445" -d '{"events": [{"server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "name": "network-vif-plugged", "status": "completed", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:51.781365 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:51.783494 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:51.817151 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f15951cf-7f5a-4a9c-864e-43bf4cf07f1c x-openstack-request-id: req-f15951cf-7f5a-4a9c-864e-43bf4cf07f1c {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:51.817454 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "name": "network-vif-plugged", "status": "completed", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:51.817713 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f15951cf-7f5a-4a9c-864e-43bf4cf07f1c {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:51.818107 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0', 'code': 200} Nov 24 16:29:51.821167 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f288ef-a5b6-429b-a665-2a96b1dd1238 req-278d6bf6-0425-4cfb-aeb7-571b917b969a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:51.822685 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c8f288ef-a5b6-429b-a665-2a96b1dd1238 req-278d6bf6-0425-4cfb-aeb7-571b917b969a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0695381 Nov 24 16:29:51.876467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:51.877555 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c8f288ef-a5b6-429b-a665-2a96b1dd1238 req-f106806c-2402-48a7-bc5f-c3c03f7b14fe tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489888 Nov 24 16:29:51.930991 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:51.986474 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b05efa-ae86-4cb3-910f-bd8529063a62 req-a8a1e505-9b91-42f5-9883-942d56052b32 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:51.988005 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c4b05efa-ae86-4cb3-910f-bd8529063a62 req-a8a1e505-9b91-42f5-9883-942d56052b32 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0540030 Nov 24 16:29:52.041152 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c4b05efa-ae86-4cb3-910f-bd8529063a62 req-1980d70e-61f0-4d1b-9dbd-4a57afa466dd tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429997 Nov 24 16:29:52.189058 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09d5a2-cadf-4ae0-b0d4-10d83b19ff86 req-2f6da9ea-73ce-401a-94c2-75f6657bc9ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:52.190547 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-de09d5a2-cadf-4ae0-b0d4-10d83b19ff86 req-2f6da9ea-73ce-401a-94c2-75f6657bc9ee service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 1099 time: 0.0404527 Nov 24 16:29:52.237036 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-de09d5a2-cadf-4ae0-b0d4-10d83b19ff86 req-f64034ac-e692-4104-9c51-5d4b9b4d0882 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380645 Nov 24 16:29:52.412472 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:53.181443 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98acf89f-a69e-4c0f-a58f-3cf69621661a req-a039129d-a18c-4082-a0c3-1798d01cca49 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:53.183667 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-98acf89f-a69e-4c0f-a58f-3cf69621661a req-a039129d-a18c-4082-a0c3-1798d01cca49 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0556271 Nov 24 16:29:53.240260 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-98acf89f-a69e-4c0f-a58f-3cf69621661a req-89d322f7-72e7-4f84-b229-4c7612432b24 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499585 Nov 24 16:29:53.240470 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267280a2-de01-4f69-a580-070c00e75d02 req-3a6453ea-1f12-4cc0-a0e2-c742711c6711 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:53.241982 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-267280a2-de01-4f69-a580-070c00e75d02 req-3a6453ea-1f12-4cc0-a0e2-c742711c6711 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.2907674 Nov 24 16:29:53.302075 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-267280a2-de01-4f69-a580-070c00e75d02 req-5662af8f-14ce-4bf1-b73a-04d9b7856dfe tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540202 Nov 24 16:29:53.772602 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f0ecb2-7ca3-479b-8772-04439c6f9456 req-c3f43fc9-fd1a-4644-90b9-e87eaf57eae8 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:53.774335 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-61f0ecb2-7ca3-479b-8772-04439c6f9456 req-c3f43fc9-fd1a-4644-90b9-e87eaf57eae8 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0530717 Nov 24 16:29:53.850897 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-61f0ecb2-7ca3-479b-8772-04439c6f9456 req-01ff2b57-d253-4930-bbaa-4d8f1b6383cb tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708992 Nov 24 16:29:53.856774 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-a8dcd9ff-7061-4990-bdbb-38919c6008b4 service neutron] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0633106 Nov 24 16:29:54.357527 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1481d66f-69d2-4f8e-a5eb-8c2cb5055784 req-563c45e2-59cd-4736-bf5a-b182b9802b21 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:54.359028 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1481d66f-69d2-4f8e-a5eb-8c2cb5055784 req-563c45e2-59cd-4736-bf5a-b182b9802b21 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0494506 Nov 24 16:29:54.407715 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1481d66f-69d2-4f8e-a5eb-8c2cb5055784 req-131116f2-862b-4d1f-8950-ecfa37d0bc2d tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427053 Nov 24 16:29:54.972620 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d56bc433-21c8-485a-bfe1-00e83353e1a1 req-f1b1e33c-9aec-4b15-80b0-efe5421d5505 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:54.974104 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d56bc433-21c8-485a-bfe1-00e83353e1a1 req-f1b1e33c-9aec-4b15-80b0-efe5421d5505 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0540652 Nov 24 16:29:55.026066 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d56bc433-21c8-485a-bfe1-00e83353e1a1 req-b005b5b4-310c-48c1-b0d9-725ab33c8729 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459964 Nov 24 16:29:55.522453 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:29:55.611973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:55.634219 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:55.639355 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c2f8faf-ffaa-4ef5-9cc6-c509bdae5635" -d '{"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-unplugged", "status": "completed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:55.650114 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:55.669783 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-286ed433-624b-4255-9824-46575c1c2920 x-openstack-request-id: req-286ed433-624b-4255-9824-46575c1c2920 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:55.670071 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-unplugged", "status": "failed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "code": 422}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:55.670366 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-286ed433-624b-4255-9824-46575c1c2920 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:55.670812 dv-cinder-819007-2-iscsi neutron-server[103143]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'code': 422} returned with failed status Nov 24 16:29:55.732528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:55.783051 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=6']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:55.788635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a479a7da-c218-4b54-a717-e02bd1f6619b req-aa904499-b775-42b8-a938-3941f6abb622 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:55.790178 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a479a7da-c218-4b54-a717-e02bd1f6619b req-aa904499-b775-42b8-a938-3941f6abb622 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0576732 Nov 24 16:29:55.838626 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a479a7da-c218-4b54-a717-e02bd1f6619b req-6530591c-0c24-46a3-83b9-982df9a85f3b tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419650 Nov 24 16:29:56.149808 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93caa12d-45dd-4622-a2ef-50d9d5858d73 req-ec77edae-cf15-4b4d-9e7f-bb915cff4dba tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.151257 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93caa12d-45dd-4622-a2ef-50d9d5858d73 req-ec77edae-cf15-4b4d-9e7f-bb915cff4dba tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0525146 Nov 24 16:29:56.200938 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-93caa12d-45dd-4622-a2ef-50d9d5858d73 req-99569b7c-aea2-4575-9ef3-1a15f33e4121 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432117 Nov 24 16:29:56.386940 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-71e21f98-3cea-46fd-a474-cd2568676ca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.388323 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-71e21f98-3cea-46fd-a474-cd2568676ca5 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29&tenant_id=34cb226439404c1cbbca2f36b3d8bec4 HTTP/1.1" status: 200 len: 1096 time: 0.0429373 Nov 24 16:29:56.452001 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-009dd774-a50f-44bf-9766-ad14d468d583 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.453666 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-009dd774-a50f-44bf-9766-ad14d468d583 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1096 time: 0.0411832 Nov 24 16:29:56.547058 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-8472842f-6fe7-4de1-bd25-99a15298f83f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.548493 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-8472842f-6fe7-4de1-bd25-99a15298f83f service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.0847478 Nov 24 16:29:56.618143 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-166c7a3f-17b7-49ca-920d-9b5d7190b1a5 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 999 time: 0.0618098 Nov 24 16:29:56.669224 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-ecebe6b1-513a-4b24-b1d3-c177559132c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.670666 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-ecebe6b1-513a-4b24-b1d3-c177559132c7 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.0429630 Nov 24 16:29:56.718089 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-99663bd1-306c-4bdc-9204-d4aafb5992fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.720193 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-99663bd1-306c-4bdc-9204-d4aafb5992fb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401843 Nov 24 16:29:56.812990 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-0eeac742-c4ab-477e-82e0-ec51e116a5b2 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841494 Nov 24 16:29:56.909909 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-78434a2c-2ed4-4230-a7cb-ce6d23ad3a07 req-196cb99e-34f7-409c-a2d0-cf3900adc76e service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889409 Nov 24 16:29:56.961679 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17517f0c-566e-4971-b047-08a352d864b0 req-3291884b-f9f1-4b52-89a6-de63704eedb0 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:56.963150 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-17517f0c-566e-4971-b047-08a352d864b0 req-3291884b-f9f1-4b52-89a6-de63704eedb0 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0520253 Nov 24 16:29:57.009784 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-17517f0c-566e-4971-b047-08a352d864b0 req-8c1ec202-48d9-47b5-acd4-d9dc015f88f6 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406730 Nov 24 16:29:57.343070 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fec3912-69c3-47d5-93eb-ce167a344a97 req-cce60e04-b6d2-4a59-83c5-674f07e5f278 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:57.344578 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0fec3912-69c3-47d5-93eb-ce167a344a97 req-cce60e04-b6d2-4a59-83c5-674f07e5f278 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0754950 Nov 24 16:29:57.352496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-15967cec-1e2f-459e-bbd8-357e80a5eef6 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:57.353812 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-15967cec-1e2f-459e-bbd8-357e80a5eef6 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 946 time: 0.0746822 Nov 24 16:29:57.452080 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0fec3912-69c3-47d5-93eb-ce167a344a97 req-1cfbe69d-3b48-40e8-a58e-e612b70e263f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0972345 Nov 24 16:29:57.473616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Deleting port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:29:57.473968 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:57.559653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] For port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:29:57.560211 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:57.579268 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Calling delete_port for 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:29:57.757774 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:57.770207 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['7e7bd72f-ede8-4b88-95d5-c07a27aac1c0'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:29:57.785806 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Pushing event deleted for resources: {'Port': ['ID=7e7bd72f-ede8-4b88-95d5-c07a27aac1c0,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:29:57.830660 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] No DVR routers for this DVR port 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:29:57.833157 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:57.836474 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-acb6c4e0-a2a6-4167-875f-f93c808b6b82 req-6bc41f73-6b16-4885-b76a-50f2a668b51c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "DELETE /v2.0/ports/7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 HTTP/1.1" status: 204 len: 173 time: 0.4755838 Nov 24 16:29:57.836907 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'name': 'network-vif-deleted', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:29:57.839163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d7fc595-ae9f-4dd9-b8fb-05da9e106a38" -d '{"events": [{"server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "name": "network-vif-deleted", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:29:57.872678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:29:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03a4981e-3459-4c70-a816-9c7f80c5b5f2 x-openstack-request-id: req-03a4981e-3459-4c70-a816-9c7f80c5b5f2 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:29:57.872994 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3600b4f2-ec03-486d-8bbc-d983ae55b03c", "name": "network-vif-deleted", "tag": "7e7bd72f-ede8-4b88-95d5-c07a27aac1c0", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:29:57.873253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-03a4981e-3459-4c70-a816-9c7f80c5b5f2 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:29:57.873655 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3600b4f2-ec03-486d-8bbc-d983ae55b03c', 'name': 'network-vif-deleted', 'tag': '7e7bd72f-ede8-4b88-95d5-c07a27aac1c0', 'status': 'completed', 'code': 200} Nov 24 16:29:58.103083 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8d0bacfa-78d1-41ea-a9c9-fc396a0b3d65 req-2800ae50-d61c-43ca-bffe-a91866bdd1ea tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=3600b4f2-ec03-486d-8bbc-d983ae55b03c HTTP/1.1" status: 200 len: 210 time: 0.0258536 Nov 24 16:29:58.577083 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40250894-4427-4bf9-8f11-a259aecfd817 req-0a6bc583-7b0b-4bb2-82ad-27b26edf2585 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:58.579148 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-40250894-4427-4bf9-8f11-a259aecfd817 req-0a6bc583-7b0b-4bb2-82ad-27b26edf2585 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0480816 Nov 24 16:29:58.631812 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-40250894-4427-4bf9-8f11-a259aecfd817 req-b01c8884-bcf5-4db0-b10a-a60b6d7fa94e tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456290 Nov 24 16:29:59.058178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:29:59.412449 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-c08fa685-fb88-43fe-b546-f633c9e19595 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:59.413778 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-c08fa685-fb88-43fe-b546-f633c9e19595 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/networks?id=1650620c-7a8c-431a-a9ce-7391af17c333 HTTP/1.1" status: 200 len: 809 time: 0.1038306 Nov 24 16:29:59.428389 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-78592df2-e09f-4d2f-b66f-eeb59905a9e1 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/quotas/b78073210f024b99bff80573db460e63 HTTP/1.1" status: 200 len: 375 time: 0.0088594 Nov 24 16:29:59.459916 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-81f47b04-e924-4249-80b9-66223fb5991f tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0261948 Nov 24 16:29:59.551191 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-b00d678b-d800-4046-a459-3e04613f2948 service neutron] 10.222.0.82 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843632 Nov 24 16:29:59.641153 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-1cfd9f46-a20c-4375-9d9f-b5fcb42f87d6 service neutron] 10.222.0.82 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834553 Nov 24 16:29:59.748265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53da7c59-0067-40f2-a987-eebed20b411e req-a620a011-419f-4823-9ff6-54204ab6eed7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:29:59.749732 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53da7c59-0067-40f2-a987-eebed20b411e req-a620a011-419f-4823-9ff6-54204ab6eed7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0483110 Nov 24 16:29:59.797936 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-53da7c59-0067-40f2-a987-eebed20b411e req-ba1fce18-4016-4c71-90c3-84475edba559 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416772 Nov 24 16:29:59.886634 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-397fc00b-d482-43a7-a326-561e28ed332d req-8fdc8825-0045-4195-8d81-61bec0b5c232 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 210 time: 0.0297940 Nov 24 16:30:00.919667 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6443992-d239-4cb9-be9a-4c93b6d97e63 req-2f18e8cf-0c9a-4e91-bee8-c0a438b406b6 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:00.921235 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a6443992-d239-4cb9-be9a-4c93b6d97e63 req-2f18e8cf-0c9a-4e91-bee8-c0a438b406b6 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0547030 Nov 24 16:30:00.976971 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a6443992-d239-4cb9-be9a-4c93b6d97e63 req-52b2a48b-1794-49fc-972c-49363bee42da tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487168 Nov 24 16:30:00.983804 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-35a0325b-513d-470b-a0d7-94ee80e51644 req-c3464e10-ceed-425b-8d7c-15636784d13a tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 210 time: 0.0253522 Nov 24 16:30:01.528386 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:01.548750 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:01.549113 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 7e7bd72f-ede8-4b88-95d5-c07a27aac1c0 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:01.846996 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-4b27fba5-8a92-4bbb-ba6a-58add8103726 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:01.848423 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-4b27fba5-8a92-4bbb-ba6a-58add8103726 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "GET /v2.0/networks?id=1650620c-7a8c-431a-a9ce-7391af17c333 HTTP/1.1" status: 200 len: 809 time: 0.1015408 Nov 24 16:30:01.864625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Request body: {'port': {'device_id': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333', 'admin_state_up': True, 'tenant_id': 'b78073210f024b99bff80573db460e63'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:30:02.127757 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bce7499-b908-4d14-9fe0-1854cbc35923 req-a036d442-26f1-403c-86f8-bf7565223d8a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:02.129394 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8bce7499-b908-4d14-9fe0-1854cbc35923 req-a036d442-26f1-403c-86f8-bf7565223d8a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0582027 Nov 24 16:30:02.182031 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-8bce7499-b908-4d14-9fe0-1854cbc35923 req-292f3050-2040-4dd8-b4ee-6b8a8c3dcaa9 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464520 Nov 24 16:30:02.230426 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d48aab10-2e72-4546-9864-d823688935b3 req-bff6573c-7f38-4e26-b363-c15f76e8ae32 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 210 time: 0.0370717 Nov 24 16:30:02.355005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Made reservation on behalf of b78073210f024b99bff80573db460e63 for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:30:02.358664 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:02.482410 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Allocated IP 172.20.0.5 (1650620c-7a8c-431a-a9ce-7391af17c333/62ccada2-06b7-48ef-aa7b-a32da4df289e/11ad3845-fb43-42bf-a721-d98b2dbbb724) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:30:02.634682 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:02.718041 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:02.762014 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Network 1650620c-7a8c-431a-a9ce-7391af17c333 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:30:02.764972 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:30:02.769163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:30:02.775754 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Pushing event updated for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:02.822878 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:02.823536 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:02.900447 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-5f4961b0-64ed-41b3-99fc-2d3baa5341ce tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0402417 Nov 24 16:30:02.918854 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Request body: {'port': {'device_id': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:30:02.968184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54694) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:02.981520 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.099978 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1aad2ec8-d7de-4da9-b5e2-689d0b8e990e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.280578 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1aad2ec8-d7de-4da9-b5e2-689d0b8e990e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.300693 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015c1f74-7e17-4bc7-a0c7-17e0bf7a9761 req-8ece4086-7cb9-47b8-b31c-51daa4bb88bc tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:03.303966 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-015c1f74-7e17-4bc7-a0c7-17e0bf7a9761 req-8ece4086-7cb9-47b8-b31c-51daa4bb88bc tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0513542 Nov 24 16:30:03.345053 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 11ad3845-fb43-42bf-a721-d98b2dbbb724 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:30:03.351322 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-015c1f74-7e17-4bc7-a0c7-17e0bf7a9761 req-dff0eefb-9119-4c2e-a3dd-ac3d08780ea0 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430882 Nov 24 16:30:03.356005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.358213 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1aad2ec8-d7de-4da9-b5e2-689d0b8e990e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.408770 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce5c5ad-7559-45e6-aeab-328d66717e86 req-dc0926ce-cf76-421e-9a5b-c728c19f3688 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:03.410231 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fce5c5ad-7559-45e6-aeab-328d66717e86 req-dc0926ce-cf76-421e-9a5b-c728c19f3688 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 931 time: 0.1059928 Nov 24 16:30:03.415102 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Transition to ACTIVE for port object 11ad3845-fb43-42bf-a721-d98b2dbbb724 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:30:03.421142 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1aad2ec8-d7de-4da9-b5e2-689d0b8e990e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=12a3d3fd10c74dc7b3f9e068aa856c83&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4520123 Nov 24 16:30:03.424601 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54702) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:03.428100 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aad2ec8-d7de-4da9-b5e2-689d0b8e990e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b1e6623-2bdc-44b5-b876-d7850dba5bc4,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:03.470213 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fce5c5ad-7559-45e6-aeab-328d66717e86 req-51a801c7-8a1a-42b1-9351-74d7ff3763ba tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525234 Nov 24 16:30:03.488609 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.496322 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.521903 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.580129 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Pushing event updated for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:03.629287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Attempting to bind port 11ad3845-fb43-42bf-a721-d98b2dbbb724 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:30:03.629648 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Attempting to bind port 11ad3845-fb43-42bf-a721-d98b2dbbb724 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:30:03.629779 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.629963 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Attempting to bind port 11ad3845-fb43-42bf-a721-d98b2dbbb724 on network 1650620c-7a8c-431a-a9ce-7391af17c333 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:30:03.632551 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.633815 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1b1e6623-2bdc-44b5-b876-d7850dba5bc4 HTTP/1.1" status: 204 len: 168 time: 0.2081993 Nov 24 16:30:03.634653 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Port 11ad3845-fb43-42bf-a721-d98b2dbbb724 on network 1650620c-7a8c-431a-a9ce-7391af17c333 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:30:03.635007 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Attempting to bind port 11ad3845-fb43-42bf-a721-d98b2dbbb724 on network 1650620c-7a8c-431a-a9ce-7391af17c333 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:30:03.640214 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 29, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:30:03.640559 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Checking segment: {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:30:03.640936 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Bound using segment: {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:30:03.641364 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Bound port: 11ad3845-fb43-42bf-a721-d98b2dbbb724, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79f9c45b-d625-445a-8047-aa0cc0f0c275', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:30:03.641772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.656872 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d6165e-e35b-44ee-8409-8aca9be1b7f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b1e6623-2bdc-44b5-b876-d7850dba5bc4,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:03.709702 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:30:03.742362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:30:03.841315 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.876878 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:03.877446 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:03.878845 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] 10.222.0.84 "PUT /v2.0/ports/11ad3845-fb43-42bf-a721-d98b2dbbb724 HTTP/1.1" status: 200 len: 1093 time: 0.9652815 Nov 24 16:30:03.879550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:30:03.881793 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea45a41c-8675-489d-ad35-27bc523799d1" -d '{"events": [{"name": "network-changed", "server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:30:03.911823 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347a112d-d66e-44cc-a42d-fb2cb87f12dd service neutron] Pushing event updated for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:03.932525 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:30:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b230234f-5012-47ea-8ee7-a61167e1dc67 x-openstack-request-id: req-b230234f-5012-47ea-8ee7-a61167e1dc67 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:30:03.933020 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:30:03.933426 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-b230234f-5012-47ea-8ee7-a61167e1dc67 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:30:03.933982 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724', 'status': 'completed', 'code': 200} Nov 24 16:30:03.998604 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-0757bbeb-9437-477a-9007-7196fb5a2ce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.000178 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-0757bbeb-9437-477a-9007-7196fb5a2ce1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 1096 time: 0.0479100 Nov 24 16:30:04.108007 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-5fefb1e9-eb85-4c68-a5de-46feebb98a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.109572 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-5fefb1e9-eb85-4c68-a5de-46feebb98a51 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=b78073210f024b99bff80573db460e63&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0996137 Nov 24 16:30:04.209179 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-2787637c-67a9-4812-93e3-aa70526d3e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.210637 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ea45a41c-8675-489d-ad35-27bc523799d1 req-2787637c-67a9-4812-93e3-aa70526d3e23 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0941529 Nov 24 16:30:04.269067 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54710) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:04.282038 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5601f48e-c5f6-4d25-9f58-3ca98e773ad5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.291386 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-2dd160b3-90cc-4374-9fd0-cf9fe8e496fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.292870 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-2dd160b3-90cc-4374-9fd0-cf9fe8e496fc service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=b78073210f024b99bff80573db460e63&device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 1096 time: 0.0438018 Nov 24 16:30:04.338118 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-ebf7b6cd-326a-462a-aba1-e30f711ec0cb service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724 HTTP/1.1" status: 200 len: 217 time: 0.0352905 Nov 24 16:30:04.356496 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5601f48e-c5f6-4d25-9f58-3ca98e773ad5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.391681 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-cffca676-5500-4ab2-a6b7-b88a04aa0836 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.393821 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-cffca676-5500-4ab2-a6b7-b88a04aa0836 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=62ccada2-06b7-48ef-aa7b-a32da4df289e HTTP/1.1" status: 200 len: 849 time: 0.0487125 Nov 24 16:30:04.423748 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5601f48e-c5f6-4d25-9f58-3ca98e773ad5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.428167 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-67724d6c-1374-4fa3-9861-b1b512b3ea4b service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=1650620c-7a8c-431a-a9ce-7391af17c333&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0259686 Nov 24 16:30:04.464277 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-5601f48e-c5f6-4d25-9f58-3ca98e773ad5 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=002a2e9a5219453282a2448459f9e7b6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1941261 Nov 24 16:30:04.465109 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5601f48e-c5f6-4d25-9f58-3ca98e773ad5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed81ad49-1516-4e2a-b9e6-812025eb1e96,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:04.467509 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54716) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:04.523510 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.532043 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1127ab5d-e182-430b-9209-d5467c532f1b req-70e56a84-17b5-4e7b-8cf2-3981c95a9c9b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.533598 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1127ab5d-e182-430b-9209-d5467c532f1b req-70e56a84-17b5-4e7b-8cf2-3981c95a9c9b tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.1077747 Nov 24 16:30:04.547554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.584812 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-6faedf42-85b9-44ca-a83c-7f02017a1854 service neutron] 10.222.0.84 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1486027 Nov 24 16:30:04.620147 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1127ab5d-e182-430b-9209-d5467c532f1b req-2e9ac061-e063-4915-a8ef-f7f71d086ac2 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0766065 Nov 24 16:30:04.621958 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea25512-99a7-4074-983d-90a62edd4507 req-4dc81692-531a-4ed1-a63a-27c67ebbc0c9 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:04.623483 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aea25512-99a7-4074-983d-90a62edd4507 req-4dc81692-531a-4ed1-a63a-27c67ebbc0c9 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 943 time: 0.0739801 Nov 24 16:30:04.680128 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aea25512-99a7-4074-983d-90a62edd4507 req-43dca971-5511-4b16-ac74-d294ad792d83 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416393 Nov 24 16:30:04.694063 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-72c7db97-823e-41c4-b164-c2a922c7fff9 req-354f08da-379f-493a-967c-9a5c64effb5a service neutron] 10.222.0.84 "GET /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0994542 Nov 24 16:30:04.763473 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.766089 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:04.767249 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/ed81ad49-1516-4e2a-b9e6-812025eb1e96 HTTP/1.1" status: 204 len: 168 time: 0.2988114 Nov 24 16:30:04.775492 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e41785a-2301-40be-8871-1c55eae3dc40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed81ad49-1516-4e2a-b9e6-812025eb1e96,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:05.389433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54724) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:05.400937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6829874-30ff-4cc7-8e9e-24da13bacdf2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.473312 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6829874-30ff-4cc7-8e9e-24da13bacdf2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.526382 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b6829874-30ff-4cc7-8e9e-24da13bacdf2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.553242 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:30:05.562309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6829874-30ff-4cc7-8e9e-24da13bacdf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=80852dc1-fbfd-4f6f-9f71-3cb1181aa922,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:05.567393 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b6829874-30ff-4cc7-8e9e-24da13bacdf2 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=36702eb640fa4f45a848d41136fb4800&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1779370 Nov 24 16:30:05.570217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54726) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:05.622166 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.644853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.664407 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:05.678651 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'port_id': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'mac_address': 'fa:16:3e:c5:04:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 893, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:30:05.738938 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.752391 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f474946c-13d2-4ac8-a779-c93737b1fb02 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:30:05.754136 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6242b247-26ef-484f-a244-6c042460a22b req-d72174f6-0671-4935-9aaf-c2af5b0108f4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:05.755959 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6242b247-26ef-484f-a244-6c042460a22b req-d72174f6-0671-4935-9aaf-c2af5b0108f4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 943 time: 0.0585692 Nov 24 16:30:05.784192 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:05.787569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.790355 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.791706 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/80852dc1-fbfd-4f6f-9f71-3cb1181aa922 HTTP/1.1" status: 204 len: 168 time: 0.2205122 Nov 24 16:30:05.813248 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9218850d-a012-46de-bd13-bd0b62f5a70b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=80852dc1-fbfd-4f6f-9f71-3cb1181aa922,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:05.824369 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6242b247-26ef-484f-a244-6c042460a22b req-7e57940b-f230-4d53-9b35-9d92a1e569fa tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599780 Nov 24 16:30:05.842673 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d71b128-2268-4d2b-9b16-2b73e363cfb6 req-87bc56ad-a424-4d66-80c3-672cf5303996 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:05.844738 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d71b128-2268-4d2b-9b16-2b73e363cfb6 req-87bc56ad-a424-4d66-80c3-672cf5303996 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 943 time: 0.0661416 Nov 24 16:30:05.878258 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:05.912539 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-3d71b128-2268-4d2b-9b16-2b73e363cfb6 req-ec53b679-35df-4db7-a1bd-f9d8d4e40354 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531311 Nov 24 16:30:05.934832 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=7']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:05.942859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.943499 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.943848 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.944190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.944532 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.944867 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.945201 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.945532 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.945894 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.946225 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.946554 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:05.946878 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:06.103873 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['f474946c-13d2-4ac8-a779-c93737b1fb02'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:30:06.353174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc6c3e5-5268-4fd7-aac0-4b4f73ee2b40 req-3b959f97-a4b2-427b-909f-e23532a8becc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:06.354716 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2fc6c3e5-5268-4fd7-aac0-4b4f73ee2b40 req-3b959f97-a4b2-427b-909f-e23532a8becc tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0536165 Nov 24 16:30:06.401324 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-2fc6c3e5-5268-4fd7-aac0-4b4f73ee2b40 req-29103f5b-28c0-45ef-96c6-ad509cd893b5 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406935 Nov 24 16:30:06.972311 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06788a19-f817-49d6-ae49-4021787f5d84 req-b87456f8-d511-4d1b-988f-5526e07aab4a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:06.975363 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06788a19-f817-49d6-ae49-4021787f5d84 req-b87456f8-d511-4d1b-988f-5526e07aab4a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 944 time: 0.0708160 Nov 24 16:30:07.026700 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad6a9b5-b7b1-4082-9e3b-ac8becbd47a0 req-6fe1ce75-dddc-406c-9d6a-40e05812f13c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:07.031386 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dad6a9b5-b7b1-4082-9e3b-ac8becbd47a0 req-6fe1ce75-dddc-406c-9d6a-40e05812f13c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 943 time: 0.0527833 Nov 24 16:30:07.033784 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-06788a19-f817-49d6-ae49-4021787f5d84 req-64801e9f-3bbd-4150-a04c-ca7aa7a9a4af tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0522521 Nov 24 16:30:07.078281 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dad6a9b5-b7b1-4082-9e3b-ac8becbd47a0 req-9c40ae6c-6673-47d8-86d0-d437db595c19 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426061 Nov 24 16:30:07.523165 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba34b7e-4489-467a-a1ee-74f7a82c95b4 req-12246ee9-0148-4ab4-8567-49f9f6796844 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:07.524696 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bba34b7e-4489-467a-a1ee-74f7a82c95b4 req-12246ee9-0148-4ab4-8567-49f9f6796844 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0533981 Nov 24 16:30:07.563991 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 11ad3845-fb43-42bf-a721-d98b2dbbb724 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:30:07.569746 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:30:07.583634 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bba34b7e-4489-467a-a1ee-74f7a82c95b4 req-78da700a-399c-408e-9073-50d6e5b0cd44 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups?id=3b7c5e72-801f-42bf-b303-f8e17d0bf744&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530608 Nov 24 16:30:07.700593 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port f474946c-13d2-4ac8-a779-c93737b1fb02 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:30:07.700967 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:07.706852 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:07.737442 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '11ad3845-fb43-42bf-a721-d98b2dbbb724', 'network_id': '1650620c-7a8c-431a-a9ce-7391af17c333', 'port_id': '11ad3845-fb43-42bf-a721-d98b2dbbb724', 'mac_address': 'fa:16:3e:21:b0:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 896, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62ccada2-06b7-48ef-aa7b-a32da4df289e', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:30:07.788136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:07.791324 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-4aae419f-0ce0-4fd6-af7d-f0b77eddc0cf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:07.792946 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-4aae419f-0ce0-4fd6-af7d-f0b77eddc0cf tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 946 time: 0.0505595 Nov 24 16:30:07.829056 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 11ad3845-fb43-42bf-a721-d98b2dbbb724 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:30:07.850464 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:07.869194 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:07.886487 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:30:07.888310 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-200c3710-b45d-4740-ac36-1713564b04a2" -d '{"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-plugged", "status": "completed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:30:07.898719 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Deleting port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:07.899106 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:07.902085 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:07.926821 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:30:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec2ed6a3-a74b-4a0e-8970-cd13e13ad3cb x-openstack-request-id: req-ec2ed6a3-a74b-4a0e-8970-cd13e13ad3cb {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:30:07.927147 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-plugged", "status": "completed", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:30:07.928135 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-ec2ed6a3-a74b-4a0e-8970-cd13e13ad3cb {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:30:07.928135 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'code': 200} Nov 24 16:30:07.936230 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:07.966712 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.001501 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:08.004407 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] For port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:08.004872 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.059748 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=8']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:08.156688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['11ad3845-fb43-42bf-a721-d98b2dbbb724'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:30:08.238819 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca309052-976b-4c0f-b259-a1e9b6e3d937 req-e125c4d7-e38f-4f75-9e11-09547bdd1ee8 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:08.240373 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca309052-976b-4c0f-b259-a1e9b6e3d937 req-e125c4d7-e38f-4f75-9e11-09547bdd1ee8 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.1251762 Nov 24 16:30:08.252708 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9027979-8e6f-402f-a84d-d8bbdf2f962f req-bfd16fac-12c8-474f-bc51-b2a9ffa38ae9 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:08.255236 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c9027979-8e6f-402f-a84d-d8bbdf2f962f req-bfd16fac-12c8-474f-bc51-b2a9ffa38ae9 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 944 time: 0.0739441 Nov 24 16:30:08.297297 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.297468 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.297777 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Floating IP 1c213342-7604-4648-a8a2-2a4a04942879 disassociated. External IP: 172.27.2.118, port: fb7e7aaa-2995-487d-b9b1-032fa34c8ec9. Nov 24 16:30:08.298112 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Calling delete_port for fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:08.317047 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c9027979-8e6f-402f-a84d-d8bbdf2f962f req-bfe702f0-a0ee-4f7a-bc4d-bbd40804d321 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529275 Nov 24 16:30:08.317935 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00bc5bff-24d5-4ff6-84dd-f334a240b368 req-5be08b78-52a5-41ed-8afa-ae838a238de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:08.319735 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-00bc5bff-24d5-4ff6-84dd-f334a240b368 req-5be08b78-52a5-41ed-8afa-ae838a238de3 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.1031883 Nov 24 16:30:08.394696 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca309052-976b-4c0f-b259-a1e9b6e3d937 req-d7ad4eb3-73df-4179-a7aa-b88b8e01e3a4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1371133 Nov 24 16:30:08.439277 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-00bc5bff-24d5-4ff6-84dd-f334a240b368 req-da2d7969-94ec-47f9-8ced-32390289ae22 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1101873 Nov 24 16:30:08.589623 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.616437 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'Port': ['ID=fb7e7aaa-2995-487d-b9b1-032fa34c8ec9,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:08.683338 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-dde2a16e-7c10-46f8-b521-02905c221ded req-5df9699c-9c83-4cd8-9417-76a808586cc4 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 210 time: 0.0260143 Nov 24 16:30:08.733881 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:30:08.847894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:30:08.859979 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-616d3532-bc35-443a-802c-4462254f630f None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:30:08.872278 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:30:08.873882 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:08.891828 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] No DVR routers for this DVR port fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:30:08.894034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:08.897579 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c08c5571-b1bd-4bfd-a27f-bd84fa5ec408 req-5f5ec232-bb94-49f1-89cd-46fdf996c747 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.84 "DELETE /v2.0/ports/fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 HTTP/1.1" status: 204 len: 173 time: 1.0976384 Nov 24 16:30:08.898035 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-deleted', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:30:08.900409 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-464ec79e-0004-430b-b511-e451b7ed2bf1" -d '{"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-deleted", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:30:08.938017 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:30:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-814220af-24ab-4ac9-a5f4-c29a3cce6927 x-openstack-request-id: req-814220af-24ab-4ac9-a5f4-c29a3cce6927 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:30:08.938315 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dee6ae8b-6d99-4d89-9373-a895b1f66ee3", "name": "network-vif-deleted", "tag": "fb7e7aaa-2995-487d-b9b1-032fa34c8ec9", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:30:08.938575 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-814220af-24ab-4ac9-a5f4-c29a3cce6927 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:30:08.939060 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dee6ae8b-6d99-4d89-9373-a895b1f66ee3', 'name': 'network-vif-deleted', 'tag': 'fb7e7aaa-2995-487d-b9b1-032fa34c8ec9', 'status': 'completed', 'code': 200} Nov 24 16:30:08.996633 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:30:09.195114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54824) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:09.226287 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:09.252494 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-616d3532-bc35-443a-802c-4462254f630f None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:30:09.260556 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:30:09.261148 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:09.321382 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-caaf436a-cce7-40f9-aa7f-b1767bac3d03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.379208 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:30:09.431471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-caaf436a-cce7-40f9-aa7f-b1767bac3d03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.467706 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac86f8f-4023-409c-940e-d2baee9cb483 req-9a2dd71e-64b8-4611-b709-6d9187a2caa8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:09.469256 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cac86f8f-4023-409c-940e-d2baee9cb483 req-9a2dd71e-64b8-4611-b709-6d9187a2caa8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 944 time: 0.0537665 Nov 24 16:30:09.539506 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-caaf436a-cce7-40f9-aa7f-b1767bac3d03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.574137 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 11ad3845-fb43-42bf-a721-d98b2dbbb724 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:30:09.586013 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-cac86f8f-4023-409c-940e-d2baee9cb483 req-e36b2cda-cb32-4490-9f52-35de40692396 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0917144 Nov 24 16:30:09.598509 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-caaf436a-cce7-40f9-aa7f-b1767bac3d03 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=52b0567323fc43b5b0e5480654b0e195&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4009001 Nov 24 16:30:09.601552 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caaf436a-cce7-40f9-aa7f-b1767bac3d03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=525b3785-d673-4ded-90ce-c840777ccbc7,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:09.602498 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54832) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:09.616743 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdc6604-a515-4aec-a6ff-0ba59f6516cc req-1484d1d3-78ce-466f-9636-c5bf17ddc5c5 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:09.623478 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efdc6604-a515-4aec-a6ff-0ba59f6516cc req-1484d1d3-78ce-466f-9636-c5bf17ddc5c5 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.1496406 Nov 24 16:30:09.678403 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.729293 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.736079 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-efdc6604-a515-4aec-a6ff-0ba59f6516cc req-6b87c3cf-4667-460d-bbe9-9e2588a72e74 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1094995 Nov 24 16:30:09.766843 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 11ad3845-fb43-42bf-a721-d98b2dbbb724 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:30:09.774583 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 11ad3845-fb43-42bf-a721-d98b2dbbb724 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:30:09.774986 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.841937 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b94db06c-75af-48dd-9035-e8aa0ae74a47 req-dbc3de07-e113-432f-9fcf-54a69466043b tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/ports?device_id=dee6ae8b-6d99-4d89-9373-a895b1f66ee3 HTTP/1.1" status: 200 len: 210 time: 0.0353692 Nov 24 16:30:09.852764 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.857930 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.859481 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/525b3785-d673-4ded-90ce-c840777ccbc7 HTTP/1.1" status: 204 len: 168 time: 0.2559726 Nov 24 16:30:09.861965 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-616d3532-bc35-443a-802c-4462254f630f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:09.871690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa38baa-0944-48a7-96ee-aee221ff2d5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=525b3785-d673-4ded-90ce-c840777ccbc7,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:09.919559 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-616d3532-bc35-443a-802c-4462254f630f None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:22:26Z', 'revision_number': 4, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8', 'name': '', 'network_id': '32d52469-d493-4e5e-ad0f-a328c47ce499', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'mac_address': 'fa:16:3e:c4:5a:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '5326d769-af24-40f0-97f9-e59937e49c37', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:24Z', 'updated_at': '2021-11-24T16:22:38Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'subnets': [{'id': '5326d769-af24-40f0-97f9-e59937e49c37', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:30:09.945661 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:09.970898 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:30:09.973164 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93757389-7ec9-411c-b7ae-c30669e00731" -d '{"events": [{"server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "name": "network-vif-plugged", "status": "completed", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:30:09.987809 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:10.012842 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:30:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b3d318e-fc2d-4747-b3db-852d5c0cc480 x-openstack-request-id: req-2b3d318e-fc2d-4747-b3db-852d5c0cc480 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:30:10.013125 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "name": "network-vif-plugged", "status": "completed", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:30:10.013381 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2b3d318e-fc2d-4747-b3db-852d5c0cc480 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:30:10.013802 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724', 'code': 200} Nov 24 16:30:10.074725 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.075793 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:10.115189 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:10.115542 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device fb7e7aaa-2995-487d-b9b1-032fa34c8ec9 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:10.145238 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:10.184336 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5fea83c-d657-406c-b7d5-8cc64bf80325 None None] New status for floating IP 1c213342-7604-4648-a8a2-2a4a04942879: DOWN {{(pid=103143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:30:10.333292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1c4fe6-fa5e-48d0-ae32-97c2c20ad0a2 req-17a792d6-595c-4b77-8ced-67e5394c4e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:10.334769 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca1c4fe6-fa5e-48d0-ae32-97c2c20ad0a2 req-17a792d6-595c-4b77-8ced-67e5394c4e45 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 1098 time: 0.0402453 Nov 24 16:30:10.381802 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ca1c4fe6-fa5e-48d0-ae32-97c2c20ad0a2 req-5f959786-f1a7-4d4e-bf19-d00bf04e78ce service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396557 Nov 24 16:30:10.534212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54844) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:10.552243 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-84f27ddc-22a4-4129-96a5-dbbb8012ea0e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.628569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-84f27ddc-22a4-4129-96a5-dbbb8012ea0e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.683579 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-84f27ddc-22a4-4129-96a5-dbbb8012ea0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.696653 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f02830c-240b-4e1f-ba18-211e68ad7269 req-37d245f0-ec13-4456-a592-e43db09025cc tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:10.698191 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f02830c-240b-4e1f-ba18-211e68ad7269 req-37d245f0-ec13-4456-a592-e43db09025cc tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.0494158 Nov 24 16:30:10.721975 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-84f27ddc-22a4-4129-96a5-dbbb8012ea0e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=c91de505ad89484eb17eb0cbb0664c74&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1867013 Nov 24 16:30:10.723880 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f27ddc-22a4-4129-96a5-dbbb8012ea0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29af10d1-c193-4568-8487-1b394b82c0dc,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:10.725088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54848) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:10.760315 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5f02830c-240b-4e1f-ba18-211e68ad7269 req-dfdcaf4e-7438-4499-9792-21b252dd0ee4 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558639 Nov 24 16:30:10.794251 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.821857 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.848490 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f45a1bd-ae33-465a-9b85-37e6fd396ac7 req-2548e9c3-8b4f-4cc8-a637-aaed37d701c4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:10.850122 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f45a1bd-ae33-465a-9b85-37e6fd396ac7 req-2548e9c3-8b4f-4cc8-a637-aaed37d701c4 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0500684 Nov 24 16:30:10.899036 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f45a1bd-ae33-465a-9b85-37e6fd396ac7 req-452e25d0-0792-41b9-a5d1-98c24c0ef32d tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430081 Nov 24 16:30:10.935813 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.938412 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:10.941973 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/29af10d1-c193-4568-8487-1b394b82c0dc HTTP/1.1" status: 204 len: 168 time: 0.2135777 Nov 24 16:30:10.949120 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4a05c6-0746-43a3-9b71-756f926a2738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29af10d1-c193-4568-8487-1b394b82c0dc,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:11.001860 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54860) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:11.057256 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.080855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.257496 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.260220 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.261415 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "DELETE /v2.0/security-groups/3b7c5e72-801f-42bf-b303-f8e17d0bf744 HTTP/1.1" status: 204 len: 168 time: 0.2583551 Nov 24 16:30:11.264116 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54862) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:11.271327 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02847930-3cac-4fa6-bbec-9a44a858ad8a tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b7c5e72-801f-42bf-b303-f8e17d0bf744,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:11.282256 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.api.v2.resource [None req-9a02e60d-0b90-4d83-9516-cae5095be734 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] show failed (client error): The resource could not be found. Nov 24 16:30:11.282256 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9a02e60d-0b90-4d83-9516-cae5095be734 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "GET /v2.0/security-groups/3b7c5e72-801f-42bf-b303-f8e17d0bf744 HTTP/1.1" status: 404 len: 347 time: 0.0142369 Nov 24 16:30:11.284188 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 54864) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:11.417073 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Deleting port 3aaf391b-32d9-4a68-848f-3d34674bc45f {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:11.417544 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.498556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.498884 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.510913 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Calling delete_port for 3aaf391b-32d9-4a68-848f-3d34674bc45f owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:11.749414 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.782655 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Pushing event deleted for resources: {'Port': ['ID=3aaf391b-32d9-4a68-848f-3d34674bc45f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:11.854579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.857380 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:11.858528 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7d2a41b1-23be-4e13-93f4-f1b9fbc03299 tempest-AttachVolumeShelveTestJSON-1505478048 tempest-AttachVolumeShelveTestJSON-1505478048-project] 10.222.0.82 "DELETE /v2.0/floatingips/1c213342-7604-4648-a8a2-2a4a04942879 HTTP/1.1" status: 204 len: 168 time: 0.5731766 Nov 24 16:30:11.899990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8eb0f71-08a4-46a5-87a5-dc895f3fc2e5 req-ede9dedc-95df-45e2-9d70-106489e4d19d tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:11.901846 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8eb0f71-08a4-46a5-87a5-dc895f3fc2e5 req-ede9dedc-95df-45e2-9d70-106489e4d19d tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.0614059 Nov 24 16:30:11.951343 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b8eb0f71-08a4-46a5-87a5-dc895f3fc2e5 req-4935173e-56a0-48e5-9ff5-bd06245c7811 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435765 Nov 24 16:30:13.312251 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5732acc-1d95-4c76-9e71-1a2478b4beab req-a01e7e54-d1ce-4d20-8977-a046d3548a61 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:13.313750 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5732acc-1d95-4c76-9e71-1a2478b4beab req-a01e7e54-d1ce-4d20-8977-a046d3548a61 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.0529969 Nov 24 16:30:13.361236 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5732acc-1d95-4c76-9e71-1a2478b4beab req-a10b430e-9252-4fb4-bb28-d0d7ad6ba29b tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408332 Nov 24 16:30:14.485534 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6557725-4df6-4255-8830-4898e2a7a38b req-120479c9-4308-41f9-8378-7470ae99ffa8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:14.492656 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a6557725-4df6-4255-8830-4898e2a7a38b req-120479c9-4308-41f9-8378-7470ae99ffa8 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.0621886 Nov 24 16:30:14.540107 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54946) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:14.550733 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a6557725-4df6-4255-8830-4898e2a7a38b req-c76c3dc8-17b0-4f9b-8593-5c46478d04e6 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522363 Nov 24 16:30:14.790038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-19d8018c-dcf5-4f19-8f36-dd9678a3369c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:14.791511 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-19d8018c-dcf5-4f19-8f36-dd9678a3369c tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.1213522 Nov 24 16:30:14.971039 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Deleting port 11ad3845-fb43-42bf-a721-d98b2dbbb724 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:14.971384 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:15.124730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] For port 11ad3845-fb43-42bf-a721-d98b2dbbb724, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=11ad3845-fb43-42bf-a721-d98b2dbbb724,segment=NetworkSegment(79f9c45b-d625-445a-8047-aa0cc0f0c275),segment_id=79f9c45b-d625-445a-8047-aa0cc0f0c275)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:15.125114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:15.148706 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Calling delete_port for 11ad3845-fb43-42bf-a721-d98b2dbbb724 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:15.151012 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:30:15.312773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:15.725405 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b7902fb-bb8d-46fc-bfd9-5347f9e3f9cd req-b432f443-d152-4762-b8ec-f52bff3c3103 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:30:15.726901 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2b7902fb-bb8d-46fc-bfd9-5347f9e3f9cd req-b432f443-d152-4762-b8ec-f52bff3c3103 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/ports?device_id=782c0600-775f-4cc5-b379-edc5ea51c4bc HTTP/1.1" status: 200 len: 945 time: 0.1098299 Nov 24 16:30:15.745434 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:15.759018 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['11ad3845-fb43-42bf-a721-d98b2dbbb724'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:30:15.813779 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Pushing event deleted for resources: {'Port': ['ID=11ad3845-fb43-42bf-a721-d98b2dbbb724,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:15.898368 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2b7902fb-bb8d-46fc-bfd9-5347f9e3f9cd req-6eb8dfbd-89e5-4060-b3fd-90d63e53702d tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.82 "GET /v2.0/security-groups?id=1efeee94-1091-4fc0-b605-570d1ca2e79d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1597064 Nov 24 16:30:15.898798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] No DVR routers for this DVR port 11ad3845-fb43-42bf-a721-d98b2dbbb724 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:30:15.901608 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:15.904970 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9044b1cf-6aac-4865-8d5d-5ca29f7af085 req-6a42456e-31df-4916-aca6-2fc855dda619 tempest-VolumesActionsTest-394262578 tempest-VolumesActionsTest-394262578-project] 10.222.0.84 "DELETE /v2.0/ports/11ad3845-fb43-42bf-a721-d98b2dbbb724 HTTP/1.1" status: 204 len: 173 time: 1.1048377 Nov 24 16:30:15.905413 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'name': 'network-vif-deleted', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:30:15.907738 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f340d967-1dc4-4ffd-991d-9785f0f802a6" -d '{"events": [{"server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "name": "network-vif-deleted", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:30:15.960949 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:30:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb993504-2e62-4b53-870e-3ed25349c5c0 x-openstack-request-id: req-eb993504-2e62-4b53-870e-3ed25349c5c0 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:30:15.961227 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "782c0600-775f-4cc5-b379-edc5ea51c4bc", "name": "network-vif-deleted", "tag": "11ad3845-fb43-42bf-a721-d98b2dbbb724", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:30:15.961523 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-eb993504-2e62-4b53-870e-3ed25349c5c0 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:30:15.961894 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '782c0600-775f-4cc5-b379-edc5ea51c4bc', 'name': 'network-vif-deleted', 'tag': '11ad3845-fb43-42bf-a721-d98b2dbbb724', 'status': 'completed', 'code': 200} Nov 24 16:30:16.016072 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Deleting port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:16.016407 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:16.101040 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] For port 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:16.101457 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:16.114389 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Calling delete_port for 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 owned by network:router_interface {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:16.375212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:16.399594 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Pushing event deleted for resources: {'Port': ['ID=382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:16.569830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:16.795283 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Router 609a1437-684b-4808-951d-468b7adf3bf0 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:30:16.909454 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-09d3da18-a9d4-42b6-a117-6e692799500b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:16.912047 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:30:16.917599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c14dbf52-fabe-4b65-9a2a-ee6bf933e0de admin admin] 10.222.0.82 "PUT /v2.0/routers/609a1437-684b-4808-951d-468b7adf3bf0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3761957 Nov 24 16:30:16.919894 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 54970) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:16.921967 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Sync routers for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:30:16.933607 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:30:16.939468 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:17.035030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.069265 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:30:17.165943 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.260569 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': '771d4bab-124a-4166-b812-d6b11b97b345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:30:16Z', 'revision_number': 5, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port': {'id': '771d4bab-124a-4166-b812-d6b11b97b345', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:59:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '609a1437-684b-4808-951d-468b7adf3bf0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:22:20Z', 'updated_at': '2021-11-24T16:22:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:17.284242 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Checking router: 609a1437-684b-4808-951d-468b7adf3bf0 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:30:17.294432 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Routers {'609a1437-684b-4808-951d-468b7adf3bf0'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:30:17.294432 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:29:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['609a1437-684b-4808-951d-468b7adf3bf0'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:17.320799 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Deleting port 771d4bab-124a-4166-b812-d6b11b97b345 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:17.323000 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.390367 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] Set router 609a1437-684b-4808-951d-468b7adf3bf0 gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:30:17.420495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] For port 771d4bab-124a-4166-b812-d6b11b97b345, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=771d4bab-124a-4166-b812-d6b11b97b345,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:17.420495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.432843 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Calling delete_port for 771d4bab-124a-4166-b812-d6b11b97b345 owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:17.441335 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:30:17Z', 'revision_number': 6, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:17.470306 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f614e1a-c37a-48a1-b7ca-eb4091102f2a None None] The sync data for ids ['609a1437-684b-4808-951d-468b7adf3bf0'] in dv-cinder-819007-2-iscsi is: [{'id': '609a1437-684b-4808-951d-468b7adf3bf0', 'name': 'tempest-AttachVolumeShelveTestJSON-1311242599-router', 'tenant_id': 'bf09fa482f8a4598be8a0e8428809467', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:22:19Z', 'updated_at': '2021-11-24T16:30:17Z', 'revision_number': 6, 'project_id': 'bf09fa482f8a4598be8a0e8428809467', 'gw_port_host': None}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:30:17.726427 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.755133 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Pushing event deleted for resources: {'Port': ['ID=771d4bab-124a-4166-b812-d6b11b97b345,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:17.814494 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.922844 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:17.926105 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.051798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.052379 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 609a1437-684b-4808-951d-468b7adf3bf0 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:30:18.056773 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.058053 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a9ea893d-9262-4d6e-81a1-422a4dfcbf5b admin admin] 10.222.0.82 "DELETE /v2.0/routers/609a1437-684b-4808-951d-468b7adf3bf0 HTTP/1.1" status: 204 len: 168 time: 1.1369059 Nov 24 16:30:18.060590 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55004) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:18.107500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Deleting subnet 5326d769-af24-40f0-97f9-e59937e49c37 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:30:18.111092 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.147264 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.228526 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.278263 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:18.320825 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:18.321866 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 382ec2d8-0c99-4ffa-a00d-9ce85f6c76c8 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:18.372200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.403126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5326d769-af24-40f0-97f9-e59937e49c37,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:18.412048 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.417744 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8732d203-70a4-49eb-882b-6c95f0faf254 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/5326d769-af24-40f0-97f9-e59937e49c37 HTTP/1.1" status: 204 len: 168 time: 0.3539455 Nov 24 16:30:18.418254 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55026) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:18.418676 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4db7d30d-ed79-48c3-b31b-cc0508d0ec52 None None] Network 32d52469-d493-4e5e-ad0f-a328c47ce499 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:30:18.496970 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.558307 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Deleting port 45e41fb9-096b-49f6-99af-8020c19bcce2 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:18.558986 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.631996 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46823749-0a12-4613-9293-6df42e07aabf None None] DHCP port deletion for 32d52469-d493-4e5e-ad0f-a328c47ce499 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:30:18.634517 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] For port 45e41fb9-096b-49f6-99af-8020c19bcce2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=45e41fb9-096b-49f6-99af-8020c19bcce2,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:18.635094 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.649390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Calling delete_port for 45e41fb9-096b-49f6-99af-8020c19bcce2 owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:18.682954 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Deleting port 45e41fb9-096b-49f6-99af-8020c19bcce2 {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:30:18.682954 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.753217 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-46823749-0a12-4613-9293-6df42e07aabf None None] For port 45e41fb9-096b-49f6-99af-8020c19bcce2, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=45e41fb9-096b-49f6-99af-8020c19bcce2,segment=NetworkSegment(6e646b11-a097-4614-8963-01958065282b),segment_id=6e646b11-a097-4614-8963-01958065282b)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:30:18.753532 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.766124 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Calling delete_port for 45e41fb9-096b-49f6-99af-8020c19bcce2 owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:30:18.806067 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.834449 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Pushing event deleted for resources: {'Port': ['ID=45e41fb9-096b-49f6-99af-8020c19bcce2,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:18.836320 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] No DVR routers for this DVR port 45e41fb9-096b-49f6-99af-8020c19bcce2 on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:30:18.846207 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.870762 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46823749-0a12-4613-9293-6df42e07aabf None None] Pushing event deleted for resources: {'Port': ['ID=45e41fb9-096b-49f6-99af-8020c19bcce2,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:18.874986 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46823749-0a12-4613-9293-6df42e07aabf None None] No DVR routers for this DVR port 45e41fb9-096b-49f6-99af-8020c19bcce2 on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:30:18.913278 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.936866 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['32d52469-d493-4e5e-ad0f-a328c47ce499']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:18.948664 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6e646b11-a097-4614-8963-01958065282b') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:18.948964 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6e646b11-a097-4614-8963-01958065282b') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:18.958173 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.970757 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.976599 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Releasing vlan 864 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:30:18.976980 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:30:18.978690 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:30:19.086464 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.092804 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.096087 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] 10.222.0.82 "DELETE /v2.0/networks/32d52469-d493-4e5e-ad0f-a328c47ce499 HTTP/1.1" status: 204 len: 168 time: 0.6765845 Nov 24 16:30:19.117031 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f23314-6240-45cd-8cbc-45e2aa7ba951 admin admin] Pushing event deleted for resources: {'Network': ['ID=32d52469-d493-4e5e-ad0f-a328c47ce499,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:19.271822 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-1a5615c8-2915-4f4c-8e58-d44eb8eae74e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.434433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55040) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:19.477885 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-6dbd962c-4c6b-4a22-94eb-44a72b860d74 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=bf09fa482f8a4598be8a0e8428809467&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0400839 Nov 24 16:30:19.478225 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55044) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:19.525324 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.551252 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.689226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.692013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:19.693544 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/61a8d3ac-b712-4abb-86a9-29a27a6adc82 HTTP/1.1" status: 204 len: 168 time: 0.2143719 Nov 24 16:30:19.701522 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c378b81-52c6-40e4-9dfd-352c66df37b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61a8d3ac-b712-4abb-86a9-29a27a6adc82,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:19.722253 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 45e41fb9-096b-49f6-99af-8020c19bcce2 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:19.742452 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 45e41fb9-096b-49f6-99af-8020c19bcce2 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:19.742803 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 45e41fb9-096b-49f6-99af-8020c19bcce2 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:19.743245 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 771d4bab-124a-4166-b812-d6b11b97b345 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:19.764560 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 771d4bab-124a-4166-b812-d6b11b97b345 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:19.764911 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 771d4bab-124a-4166-b812-d6b11b97b345 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:20.366610 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:21.276450 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 11ad3845-fb43-42bf-a721-d98b2dbbb724 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:30:21.296923 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 11ad3845-fb43-42bf-a721-d98b2dbbb724 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:30:21.297278 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 11ad3845-fb43-42bf-a721-d98b2dbbb724 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:30:21.740769 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:22.414788 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.123311 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.557718 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55228) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:29.689498 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.770278 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.846847 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.898610 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=78994512c4184925806724f797cbabee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3391159 Nov 24 16:30:29.900061 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9a5d61b-8713-485c-97c4-e9335de75d8d,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:29.901632 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55236) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:29.913723 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.919199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d48bba5-605a-4fcc-b062-afb87c577e32 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:29.954354 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:29.977732 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:30.103986 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:30.107527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:30.109141 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a9a5d61b-8713-485c-97c4-e9335de75d8d HTTP/1.1" status: 204 len: 168 time: 0.2062750 Nov 24 16:30:30.121511 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9a5d61b-8713-485c-97c4-e9335de75d8d,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:30.131081 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.131855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.132438 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.133042 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.133594 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.134177 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.134754 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.135571 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.136032 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.136407 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.136966 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.138552 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5602dd0f-b7d1-4e6e-a1de-4f9dea206aa7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:30:30.851541 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55262) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:30.870343 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55264) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:30.890728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56dd76e1-6632-4986-917b-893450ae2052 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.052069 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56dd76e1-6632-4986-917b-893450ae2052 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.106430 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e51ae5f-1e72-4677-92d0-1b53c5ddddea admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.108448 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-56dd76e1-6632-4986-917b-893450ae2052 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.174342 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-56dd76e1-6632-4986-917b-893450ae2052 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9569a6483b9942be894ef1e2ed69edb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3210082 Nov 24 16:30:31.178258 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56dd76e1-6632-4986-917b-893450ae2052 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83a47e11-1130-4201-a178-7328ba286392,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:31.182147 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55268) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:31.265134 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.278518 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e51ae5f-1e72-4677-92d0-1b53c5ddddea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.295675 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.350119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4e51ae5f-1e72-4677-92d0-1b53c5ddddea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.383382 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4e51ae5f-1e72-4677-92d0-1b53c5ddddea admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=9763ae899c36497eae2b3d30e0e167c2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5095768 Nov 24 16:30:31.387385 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55270) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:31.415519 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e51ae5f-1e72-4677-92d0-1b53c5ddddea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16bfdbd3-4678-413c-a178-0a555adb3f41,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:31.433719 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.436806 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.438060 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/83a47e11-1130-4201-a178-7328ba286392 HTTP/1.1" status: 204 len: 168 time: 0.2521830 Nov 24 16:30:31.466164 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4240b8-e4d2-4ad4-b098-f816371ee54e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83a47e11-1130-4201-a178-7328ba286392,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:31.495112 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.533550 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.729502 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.733825 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:31.741069 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/16bfdbd3-4678-413c-a178-0a555adb3f41 HTTP/1.1" status: 204 len: 168 time: 0.3469942 Nov 24 16:30:31.764238 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dee3c8c-ed28-4aa1-b372-88ced9db6d42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16bfdbd3-4678-413c-a178-0a555adb3f41,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:39.332231 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55432) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:39.464214 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-718a1648-e654-478a-9dec-f7b624a366e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:39.549727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-718a1648-e654-478a-9dec-f7b624a366e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:39.732304 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-718a1648-e654-478a-9dec-f7b624a366e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:39.777534 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-718a1648-e654-478a-9dec-f7b624a366e1 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=554b8b0ecb694e17bb4b6fc86ae18093&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4435122 Nov 24 16:30:39.778662 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718a1648-e654-478a-9dec-f7b624a366e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5ff6d40-f115-46fa-8837-be762205aa31,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:39.780624 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55442) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:39.880389 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:39.915384 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:40.077226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:40.080690 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:40.082937 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/a5ff6d40-f115-46fa-8837-be762205aa31 HTTP/1.1" status: 204 len: 168 time: 0.3011463 Nov 24 16:30:40.099198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df966f2-fed2-4f18-8e20-23ea82665a75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5ff6d40-f115-46fa-8837-be762205aa31,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:45.450264 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55588) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:45.552979 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-501bdf34-98e7-47ec-b239-ead3b004eded admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.628189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-501bdf34-98e7-47ec-b239-ead3b004eded admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.725196 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-501bdf34-98e7-47ec-b239-ead3b004eded admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.762339 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501bdf34-98e7-47ec-b239-ead3b004eded admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72ca01df-f7e5-4a08-97ca-c892ceb71eb8,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:45.767270 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-501bdf34-98e7-47ec-b239-ead3b004eded admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=4c2e816419864ac48dbddc1cc1944007&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3154182 Nov 24 16:30:45.770061 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55598) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:45.817097 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.839327 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.968770 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.971328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:45.972475 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/72ca01df-f7e5-4a08-97ca-c892ceb71eb8 HTTP/1.1" status: 204 len: 168 time: 0.2016332 Nov 24 16:30:45.980063 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a4b627-a79e-4625-a5a6-8e948e796f65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72ca01df-f7e5-4a08-97ca-c892ceb71eb8,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:46.906054 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-46957587-d180-47bb-97eb-5bfeda6fc694 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:48.708703 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55738) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:48.814851 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57d64aa4-5ee0-4ccf-b7b0-c32baf6dccca admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:48.887878 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55748) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:48.889582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57d64aa4-5ee0-4ccf-b7b0-c32baf6dccca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:48.933302 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Deleting subnet 62ccada2-06b7-48ef-aa7b-a32da4df289e {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:30:48.936311 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:48.965425 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57d64aa4-5ee0-4ccf-b7b0-c32baf6dccca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:48.971856 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25189480'] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.004811 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-57d64aa4-5ee0-4ccf-b7b0-c32baf6dccca admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=1c89d1b46aa34baab628f59683979fcd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2949555 Nov 24 16:30:49.005772 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d64aa4-5ee0-4ccf-b7b0-c32baf6dccca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3e538b9-8afb-4595-8637-850fe7179e8d,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:49.008121 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55750) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:49.011403 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.056085 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.079456 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.120369 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25423536', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25555699'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.144421 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62ccada2-06b7-48ef-aa7b-a32da4df289e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:49.151337 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.154513 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-06d44158-72f4-415e-bf27-a22228a4b91e admin admin] 10.222.0.82 "DELETE /v2.0/subnets/62ccada2-06b7-48ef-aa7b-a32da4df289e HTTP/1.1" status: 204 len: 168 time: 0.2655931 Nov 24 16:30:49.158020 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55752) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:49.218765 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.221911 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.223069 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/e3e538b9-8afb-4595-8637-850fe7179e8d HTTP/1.1" status: 204 len: 168 time: 0.2140164 Nov 24 16:30:49.239842 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.242571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7e6fc5a-c2e9-4497-99e8-ed77fb3a2b4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3e538b9-8afb-4595-8637-850fe7179e8d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:49.243117 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e14c1f3a-c649-4f1b-a369-b01beb4fe4d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.331993 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.356528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1650620c-7a8c-431a-a9ce-7391af17c333']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:49.366664 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '79f9c45b-d625-445a-8047-aa0cc0f0c275') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:49.367256 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '79f9c45b-d625-445a-8047-aa0cc0f0c275') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:30:49.378807 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.393475 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.399831 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Releasing vlan 896 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:30:49.400085 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:30:49.401770 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:30:49.522678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.528569 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.533308 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] 10.222.0.82 "DELETE /v2.0/networks/1650620c-7a8c-431a-a9ce-7391af17c333 HTTP/1.1" status: 204 len: 168 time: 0.3729246 Nov 24 16:30:49.542933 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e1fb4f-4ada-40b5-b32f-bda48b03d464 admin admin] Pushing event deleted for resources: {'Network': ['ID=1650620c-7a8c-431a-a9ce-7391af17c333,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:49.833625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55764) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:49.847438 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e70d13ce-c9dc-4f09-8c93-dca1f0484865 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.926548 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e70d13ce-c9dc-4f09-8c93-dca1f0484865 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:49.941128 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55766) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:49.982178 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-400b3311-9e7e-4aa4-82cc-7b0f6b14347a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b78073210f024b99bff80573db460e63&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398350 Nov 24 16:30:49.984486 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55768) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:49.999458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e70d13ce-c9dc-4f09-8c93-dca1f0484865 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.056325 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e70d13ce-c9dc-4f09-8c93-dca1f0484865 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=11b9c5f776844a969f7160ec71f78dcb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2214711 Nov 24 16:30:50.058742 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e70d13ce-c9dc-4f09-8c93-dca1f0484865 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b420190-1f0c-489e-8046-b5e3817e955e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:50.058970 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 55770) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:30:50.076822 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.099193 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.121104 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.144015 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.234066 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.236656 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.237802 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1efeee94-1091-4fc0-b605-570d1ca2e79d HTTP/1.1" status: 204 len: 168 time: 0.2524314 Nov 24 16:30:50.245603 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e56a4a-ef46-4758-a678-14602eab7c1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1efeee94-1091-4fc0-b605-570d1ca2e79d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:50.274045 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.276965 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:50.278384 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8b420190-1f0c-489e-8046-b5e3817e955e HTTP/1.1" status: 204 len: 168 time: 0.2184272 Nov 24 16:30:50.286988 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4221dad-5b2c-476b-b56f-714473f93af2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b420190-1f0c-489e-8046-b5e3817e955e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:30:50.422127 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:51.729343 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:52.150055 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:30:52.457042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:30:59.056289 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.410983 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 55996) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:01.513850 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f932da20-0bf4-4040-a079-995b2cb3064f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.589800 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f932da20-0bf4-4040-a079-995b2cb3064f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.725232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-f932da20-0bf4-4040-a079-995b2cb3064f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.762362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f932da20-0bf4-4040-a079-995b2cb3064f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=acfa18d4-ecab-4f55-96c1-209cce25dfba,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:01.766505 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-f932da20-0bf4-4040-a079-995b2cb3064f admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=8be7b04bdcd44360973d6596ce470849&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3545415 Nov 24 16:31:01.769171 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56000) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:01.816283 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.836612 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.942564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.945239 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:01.946387 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/acfa18d4-ecab-4f55-96c1-209cce25dfba HTTP/1.1" status: 204 len: 168 time: 0.1763351 Nov 24 16:31:01.954358 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57dc93e0-ff2f-4e74-b012-b642a070a1e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=acfa18d4-ecab-4f55-96c1-209cce25dfba,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:02.464428 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56008) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:02.477387 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35644f70-0038-426b-a3d1-11460d690644 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.553080 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35644f70-0038-426b-a3d1-11460d690644 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.639397 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35644f70-0038-426b-a3d1-11460d690644 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.682182 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-35644f70-0038-426b-a3d1-11460d690644 admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=7710c36cd2f04c39be264e29e36de910&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2166839 Nov 24 16:31:02.682897 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35644f70-0038-426b-a3d1-11460d690644 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3ac0e85-7c31-4952-a4dd-97b4c986f63e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:02.684886 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56010) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:02.733555 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.754841 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.868621 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.871268 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:02.872465 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f3ac0e85-7c31-4952-a4dd-97b4c986f63e HTTP/1.1" status: 204 len: 168 time: 0.1865849 Nov 24 16:31:02.880451 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbcbe617-5890-4140-be99-b338820ed133 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3ac0e85-7c31-4952-a4dd-97b4c986f63e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:03.533351 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56018) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:03.547627 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a8138289-854c-4c61-9b12-9e1d7c88e22c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.620730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a8138289-854c-4c61-9b12-9e1d7c88e22c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.679782 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a8138289-854c-4c61-9b12-9e1d7c88e22c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.727121 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a8138289-854c-4c61-9b12-9e1d7c88e22c admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=2b262d9839404be09a5193786948c0ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1926198 Nov 24 16:31:03.727988 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8138289-854c-4c61-9b12-9e1d7c88e22c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2655409a-58e5-438f-abb2-e739b43d9f69,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:03.729808 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56020) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:03.779773 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.803495 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.919579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.922209 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:03.923436 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/2655409a-58e5-438f-abb2-e739b43d9f69 HTTP/1.1" status: 204 len: 168 time: 0.1926346 Nov 24 16:31:03.932014 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103ac5b9-426d-44b2-b3bc-8c62df900662 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2655409a-58e5-438f-abb2-e739b43d9f69,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:08.557690 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56074) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:08.667123 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-acc77d11-459b-46cc-be7a-a937e79ede5a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:08.740036 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-acc77d11-459b-46cc-be7a-a937e79ede5a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:08.833861 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-acc77d11-459b-46cc-be7a-a937e79ede5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:08.871170 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc77d11-459b-46cc-be7a-a937e79ede5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d042c07-433b-49f0-98a0-a27a65a2a696,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:08.875427 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-acc77d11-459b-46cc-be7a-a937e79ede5a admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=d709649b1caf470c88d722ca0c45f4d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3166881 Nov 24 16:31:08.878623 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56078) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:08.925069 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:08.947844 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:09.073895 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:09.076628 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:09.077970 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/8d042c07-433b-49f0-98a0-a27a65a2a696 HTTP/1.1" status: 204 len: 168 time: 0.1987815 Nov 24 16:31:09.085874 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89665ac3-fbcd-4259-bc20-992fe4ba2c12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d042c07-433b-49f0-98a0-a27a65a2a696,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:16.924553 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6b17529e-235e-47f8-9f3d-a4aec8fbedab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:19.249973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3c4c2f62-9a97-4166-9932-511bb3e82fdc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:20.387144 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:21.716261 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:22.584943 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:22.875637 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56150) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:22.977199 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5d8f142b-26f1-486e-a9f5-59c08b24b9da admin admin] Publish callbacks [] for security_group, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.048013 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5d8f142b-26f1-486e-a9f5-59c08b24b9da admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.122224 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5d8f142b-26f1-486e-a9f5-59c08b24b9da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.158777 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d8f142b-26f1-486e-a9f5-59c08b24b9da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=370f007f-d755-495a-a190-ad6503b0efaa,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:23.163088 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-5d8f142b-26f1-486e-a9f5-59c08b24b9da admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=943c487d199d4204be344e4eb03a7fc0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2864180 Nov 24 16:31:23.165668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56154) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:23.215567 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.236076 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.324441 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.327118 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:23.328268 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/370f007f-d755-495a-a190-ad6503b0efaa HTTP/1.1" status: 204 len: 168 time: 0.1617036 Nov 24 16:31:23.335731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d58e43-312c-4f1f-9e04-95078ce11954 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=370f007f-d755-495a-a190-ad6503b0efaa,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:24.198984 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56176) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:24.291413 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1071257930-network', 'tenant_id': '3b37384f944943228da7761c28d2688c'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:24.358927 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Made reservation on behalf of 3b37384f944943228da7761c28d2688c for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:31:24.361079 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.369342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.440321 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.516393 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.542671 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 892} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:31:24.548795 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=643892f7-4b45-4ee5-81f2-6e0ee2ea4eed,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:24.554571 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.554925 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Added segment 01daf12f-03fc-4264-b82d-d482465642e8 of type vlan for network d5daf004-999b-4292-8917-46525a8f363e Nov 24 16:31:24.595880 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.689955 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.690824 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:24.691714 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:24.751942 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] Pushing event updated for resources: {'Network': ['ID=d5daf004-999b-4292-8917-46525a8f363e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:24.761254 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-25e80aa8-a40e-4841-b223-40106e40f1dd admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5611815 Nov 24 16:31:24.761951 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network d5daf004-999b-4292-8917-46525a8f363e details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:31:24.764116 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56180) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:24.768802 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Request body: {'subnet': {'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1071257930-subnet', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'ip_version': 4}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:24.850295 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Made reservation on behalf of 3b37384f944943228da7761c28d2688c for: {'subnet': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:31:24.853227 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25555672'] for subnet, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.073443 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25423471', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25555658'] for subnet, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.127056 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Pushing event updated for resources: {'Subnet': ['ID=ed51ff75-126f-45c3-ab4f-52644e5c0709,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:25.136834 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103141) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:25.137191 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Network hostable DHCP agents. Network: d5daf004-999b-4292-8917-46525a8f363e, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103141) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:31:25.209855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Network d5daf004-999b-4292-8917-46525a8f363e is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103141) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:31:25.273024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, d5daf004-999b-4292-8917-46525a8f363e) {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:25.279770 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:25.281167 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.285279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d59b9ddf-c74c-449e-a121-ffe02ef54e43 None None] Network d5daf004-999b-4292-8917-46525a8f363e requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:25.350653 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-7070bb97-1c1f-4b1d-8c5e-601153f9909f admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5852847 Nov 24 16:31:25.353658 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56182) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:25.357860 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:25.440232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.440232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.440812 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-d5daf004-999b-4292-8917-46525a8f363e', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:31:25.441879 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.493944 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.575280 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Allocated IP 172.20.0.2 (d5daf004-999b-4292-8917-46525a8f363e/ed51ff75-126f-45c3-ab4f-52644e5c0709/b90d1df9-fa7f-4603-96e6-c0bc6e22b15d) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:25.679202 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.716103 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.876687 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:25.916934 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:25.921249 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:25.923651 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:25.931421 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Pushing event updated for resources: {'Port': ['ID=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:25.959216 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.959565 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.959904 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.960236 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.960563 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.960889 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.961216 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.961570 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.961893 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.962213 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.962529 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.962847 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:25.993777 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Attempting to bind port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:25.994153 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Attempting to bind port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:25.994526 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Attempting to bind port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:25.999485 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:25.999863 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:26.000270 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.000674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Bound using segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:26.001142 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Bound port: b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:26.001528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.036932 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.055001 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.062795 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] For port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:26.065792 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] For port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:26.165893 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Allocated IP 172.27.2.69 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/8a032bdb-52a8-4eff-ad41-d22dba1df794) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:26.168443 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.228003 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b3b84a-ac52-4893-a724-fb007d46b30a None None] Pushing event updated for resources: {'Port': ['ID=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:26.269587 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.382360 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:26.428385 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:26.432956 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:26.436711 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:26.444193 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Pushing event updated for resources: {'Port': ['ID=8a032bdb-52a8-4eff-ad41-d22dba1df794,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:26.755567 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.071270 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a38ad06-bde3-4f55-865b-cf62883f81ab None None] Network d5daf004-999b-4292-8917-46525a8f363e requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:27.142160 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] Provisioning complete for port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:27.142525 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.190639 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.284489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.324936 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] For port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:27.385226 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Router 88146987-20b4-4767-bd2d-292198f0b7a8 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:31:27.413981 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.472896 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50935940-f5a6-4d5b-8bd6-6cfac0240767 None None] Pushing event updated for resources: {'Port': ['ID=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:27.499247 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:27.515864 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:27.537621 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:27.537621 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:27.583743 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-3742a0e6-936d-4619-b02f-66f42ece39c2 None None] Provisioning complete for port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:27.589437 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3742a0e6-936d-4619-b02f-66f42ece39c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.610222 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.612496 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-44b5fd45-384d-492e-9aeb-fbe153e8256d admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.2569087 Nov 24 16:31:27.614264 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56184) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:27.688097 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:27.808767 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b90d1df9-fa7f-4603-96e6-c0bc6e22b15d up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:27.942983 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:27.943358 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:27.999357 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:26Z', 'revision_number': 3, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:28.030019 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:28.030583 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Updating router 88146987-20b4-4767-bd2d-292198f0b7a8 port 8a032bdb-52a8-4eff-ad41-d22dba1df794 binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:31:28.087056 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.096139 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.260179 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Allocated IP 172.20.0.1 (d5daf004-999b-4292-8917-46525a8f363e/ed51ff75-126f-45c3-ab4f-52644e5c0709/136d5333-b159-4ef7-a144-e7d1ca8b998e) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:28.351082 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.359718 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.419148 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.471499 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Attempting to bind port 8a032bdb-52a8-4eff-ad41-d22dba1df794 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:28.471875 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Attempting to bind port 8a032bdb-52a8-4eff-ad41-d22dba1df794 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:28.472240 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Attempting to bind port 8a032bdb-52a8-4eff-ad41-d22dba1df794 on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:28.474984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4ddcbb-e624-4538-8227-62e44601319e None None] Pushing event updated for resources: {'Port': ['ID=8a032bdb-52a8-4eff-ad41-d22dba1df794,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:28.479554 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.480076 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:28.480372 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:28.480869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.481165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:28.481632 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Bound port: 8a032bdb-52a8-4eff-ad41-d22dba1df794, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:28.482370 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.512834 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:28.515701 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:28.518163 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:28.541406 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] For port 8a032bdb-52a8-4eff-ad41-d22dba1df794, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:28.545632 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] For port 8a032bdb-52a8-4eff-ad41-d22dba1df794, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8a032bdb-52a8-4eff-ad41-d22dba1df794,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:28.564217 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Pushing event updated for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:28.578080 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.628683 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.690379 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:28.691031 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:28.693102 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4ddcbb-e624-4538-8227-62e44601319e None None] Pushing event updated for resources: {'Port': ['ID=8a032bdb-52a8-4eff-ad41-d22dba1df794,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:28.771464 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.925705 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-d6f60fd5-e257-4944-9994-e741e47c36b0 None None] Provisioning complete for port 136d5333-b159-4ef7-a144-e7d1ca8b998e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:28.925960 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d6f60fd5-e257-4944-9994-e741e47c36b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.928455 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:28.933079 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:28.998342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.031710 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-d6f60fd5-e257-4944-9994-e741e47c36b0 None None] Port 136d5333-b159-4ef7-a144-e7d1ca8b998e cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:29.067202 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Pushing event updated for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:29.069538 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.098179 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.150232 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:31:29.151933 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:26Z', 'revision_number': 3, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:29.161009 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:29.162531 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:29.178674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bef0e83c-293c-4862-b671-071ace5f9fbb None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:26Z', 'revision_number': 3, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:29.283552 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:31:29.411117 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:29.417378 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-50f136e9-4b97-4bd9-bc87-5e1a886348b4 admin admin] 10.222.0.82 "PUT /v2.0/routers/88146987-20b4-4767-bd2d-292198f0b7a8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8020904 Nov 24 16:31:29.457008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-44de31d9-1e88-408d-8680-c3269867bf0b None None] Provisioning complete for port 136d5333-b159-4ef7-a144-e7d1ca8b998e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:29.457641 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-44de31d9-1e88-408d-8680-c3269867bf0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.498939 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-44de31d9-1e88-408d-8680-c3269867bf0b None None] Port 136d5333-b159-4ef7-a144-e7d1ca8b998e cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:29.785689 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8a032bdb-52a8-4eff-ad41-d22dba1df794 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:29.839993 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 8a032bdb-52a8-4eff-ad41-d22dba1df794 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:29.840406 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.924501 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:29.945724 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 8a032bdb-52a8-4eff-ad41-d22dba1df794, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8a032bdb-52a8-4eff-ad41-d22dba1df794,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:30.061458 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.115674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=8a032bdb-52a8-4eff-ad41-d22dba1df794,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:30.146239 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56200) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:30.151912 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-390472717-network', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:30.227074 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Made reservation on behalf of 90dddcb32d9747c8a90b8ad9fbd47ef8 for: {'network': 1} {{(pid=103141) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:31:30.229441 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for network, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.238627 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.311123 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.375769 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.405644 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 873} {{(pid=103141) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 16:31:30.415321 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71374cb9-4693-414a-b210-82c23cf9eaf5,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:30.424662 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.425058 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.segments_db [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Added segment 16ac500b-6232-434f-893b-d3baa2e29d82 of type vlan for network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.431512 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:30.474928 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8778969715752'] for network, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.547222 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662'] for network, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.548306 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:30.548905 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.608862 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] Pushing event updated for resources: {'Network': ['ID=5da62686-a1fb-4288-ae81-9fdc2d8f7dd3,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:30.619391 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 details requested by agent ovs-agent-dv-cinder-819007-2-iscsi with host dv-cinder-819007-2-iscsi {{(pid=103143) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 16:31:30.667641 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ff9d9fa2-db59-4739-8afa-8c08d8dd507d admin admin] 10.222.0.82 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5202606 Nov 24 16:31:30.670613 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56202) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:30.673710 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:30.675634 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Request body: {'subnet': {'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-390472717-subnet', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'ip_version': 4}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:30.684803 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:30.685774 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:30.770367 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Made reservation on behalf of 90dddcb32d9747c8a90b8ad9fbd47ef8 for: {'subnet': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:31:30.772717 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25215965'] for subnet, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:30.789903 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:30.984178 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 2, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:31.004628 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-26164714', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25215951'] for subnet, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.010267 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:31.010623 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Updating router 88146987-20b4-4767-bd2d-292198f0b7a8 port 136d5333-b159-4ef7-a144-e7d1ca8b998e binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:31:31.059758 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Pushing event updated for resources: {'Subnet': ['ID=ca402e9d-3db8-40f8-baec-fffd914af1aa,revision_number=0']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:31.071629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.071984 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.072322 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.072656 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.072986 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.073317 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.073639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.073967 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.074292 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.074622 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.074949 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.075275 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.083217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Checking segment: {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:31.083585 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Network hostable DHCP agents. Network: 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3, hostable agents: ['4f26e063-4114-46dc-aa5d-d11a85b188ae'], hosted agents: [] {{(pid=103142) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 16:31:31.124674 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.152910 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 is scheduled to be hosted by DHCP agent 4f26e063-4114-46dc-aa5d-d11a85b188ae with binding_index 1 {{(pid=103142) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 16:31:31.207657 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819007-2-iscsi, 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3) {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:31.212846 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:31.213998 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.217901 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a62959f-84c2-4768-b42c-2897d61a88ad None None] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:31.286329 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dfa0bef3-d79f-44a8-a071-2a6c78118eeb admin admin] 10.222.0.82 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6122725 Nov 24 16:31:31.286821 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56204) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:31.291970 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:31.303427 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-d9ce5d67-375c-4a6d-a0bd-795f0d891978 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0549617 Nov 24 16:31:31.359697 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-3959508', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-14009'] for router, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.361255 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3810772', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3817390', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3738571', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13966'] for router, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.393725 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.394722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpcc9ea3a8-bf22-5d9d-ba9b-726e7f9b6933-5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa'}]}} from dv-cinder-819007-2-iscsi. {{(pid=103143) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 16:31:31.396343 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.401522 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-e7e2fded-fa6d-49a4-bb94-db8a2bfd73fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:31.403222 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-e7e2fded-fa6d-49a4-bb94-db8a2bfd73fb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.0512283 Nov 24 16:31:31.441585 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.462019 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.511656 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Pushing event updated for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:31.514077 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-42d533c2-2002-4531-9e3c-b250faf9cddf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:31.516171 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-42d533c2-2002-4531-9e3c-b250faf9cddf service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.0920582 Nov 24 16:31:31.520127 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.523231 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.525176 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.525176 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103144) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:31:31.567062 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.db_base_plugin_common [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Allocated IP 172.20.0.2 (5da62686-a1fb-4288-ae81-9fdc2d8f7dd3/ca402e9d-3db8-40f8-baec-fffd914af1aa/8731ae86-043a-4cb2-9872-94ab32e5f3db) {{(pid=103143) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:31.624277 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-bf6025a8-fd42-4f49-aee6-92fade093461 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 1001 time: 0.0935159 Nov 24 16:31:31.636772 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Attempting to bind port 136d5333-b159-4ef7-a144-e7d1ca8b998e on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:31.637428 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Attempting to bind port 136d5333-b159-4ef7-a144-e7d1ca8b998e by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:31.637962 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Attempting to bind port 136d5333-b159-4ef7-a144-e7d1ca8b998e on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:31.643726 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:31.644102 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:31.644534 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.644916 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Bound using segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:31.645395 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Bound port: 136d5333-b159-4ef7-a144-e7d1ca8b998e, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:31.645783 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.679177 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.698340 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-97b6fd4f-d529-495f-8745-5514251249aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:31.700436 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-97b6fd4f-d529-495f-8745-5514251249aa service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.0655046 Nov 24 16:31:31.745073 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] For port 136d5333-b159-4ef7-a144-e7d1ca8b998e, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:31.749490 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] For port 136d5333-b159-4ef7-a144-e7d1ca8b998e, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=136d5333-b159-4ef7-a144-e7d1ca8b998e,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:31.764752 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-39f3ed15-95f6-4c35-a400-6eff1999914e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:31.769977 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-39f3ed15-95f6-4c35-a400-6eff1999914e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0575585 Nov 24 16:31:31.779947 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks [] for port, precommit_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.782861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8a032bdb-52a8-4eff-ad41-d22dba1df794 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:31.838409 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-137cbd01-0012-4b0c-993a-7511404d64de None None] Provisioning complete for port 136d5333-b159-4ef7-a144-e7d1ca8b998e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:31.838798 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-137cbd01-0012-4b0c-993a-7511404d64de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.850764 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.872138 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 8a032bdb-52a8-4eff-ad41-d22dba1df794 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:31.872516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.887613 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-f527b72b-ab53-4412-ba77-964014406930 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1069806 Nov 24 16:31:31.900993 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690'] for port, after_create {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:31.910927 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-137cbd01-0012-4b0c-993a-7511404d64de None None] Port 136d5333-b159-4ef7-a144-e7d1ca8b998e cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:31.912517 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389994b2-9e0f-4001-97c8-9be004f2c729 None None] Pushing event updated for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=4']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:31.932319 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:31.932938 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:31.961766 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 is already hosted by enough agents. {{(pid=103143) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:31.968622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.scheduler.base_scheduler [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Resources bound (agent type, host, resource id): {{(pid=103143) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:31.974323 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Received port after_create {{(pid=103143) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:31.981117 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Pushing event updated for resources: {'Port': ['ID=8731ae86-043a-4cb2-9872-94ab32e5f3db,revision_number=1']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:32.005717 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.036435 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-074c67c5-ad7f-40ea-91bd-6d923eee9762 req-4793fbf6-fb45-46a2-8296-de2a481c5ab2 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403763 Nov 24 16:31:32.045780 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.080320 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:32.095490 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Attempting to bind port 8731ae86-043a-4cb2-9872-94ab32e5f3db on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:32.095869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Attempting to bind port 8731ae86-043a-4cb2-9872-94ab32e5f3db by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:32.096241 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Attempting to bind port 8731ae86-043a-4cb2-9872-94ab32e5f3db on network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:32.110046 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:32.118290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Checking segment: {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:32.118290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.118290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Bound using segment: {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:32.118290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Bound port: 8731ae86-043a-4cb2-9872-94ab32e5f3db, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:32.118290 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.186055 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Allocated IP 172.27.2.100 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/0535eb8a-a115-4960-a1f7-8c6251a0128c) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:32.198303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] For port 8731ae86-043a-4cb2-9872-94ab32e5f3db, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:32.202018 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] For port 8731ae86-043a-4cb2-9872-94ab32e5f3db, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8731ae86-043a-4cb2-9872-94ab32e5f3db,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:32.235482 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] Provisioning complete for port 136d5333-b159-4ef7-a144-e7d1ca8b998e triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:32.238418 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.298793 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.304204 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.329876 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:31Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:32.355703 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.358385 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6687929e-c3dd-4dd7-8760-eb829f37cc9f None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:31Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:32.392437 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b779fbfc-a9c5-4028-ad1a-aef0151bf393 None None] Pushing event updated for resources: {'Port': ['ID=8731ae86-043a-4cb2-9872-94ab32e5f3db,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:32.424717 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.438058 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] For port 136d5333-b159-4ef7-a144-e7d1ca8b998e, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=136d5333-b159-4ef7-a144-e7d1ca8b998e,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:32.473491 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:32.478312 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:32.481951 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:32.512259 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Pushing event updated for resources: {'Port': ['ID=0535eb8a-a115-4960-a1f7-8c6251a0128c,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:32.530849 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:32.600704 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0539c28d-db9c-4d8e-a33f-832d0110dfbb None None] Pushing event updated for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:32.910071 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:33.119698 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3810673', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3810143'] for router, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:33.316887 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Router 25763a8c-3524-4cc2-b11e-226895f1ac53 is scheduled to L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e with binding_index 1 {{(pid=103141) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 16:31:33.424204 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ef9214e-0597-44cd-836d-5e80397d1955 None None] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:33.430728 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:33.462004 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Sync routers for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:33.511928 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:33.512574 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:33.515395 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:33.515395 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ba1e18dc-da1e-4cd2-aca8-20819e9f0dfd admin admin] 10.222.0.82 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.2265210 Nov 24 16:31:33.517367 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56212) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:33.580128 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] Provisioning complete for port 8731ae86-043a-4cb2-9872-94ab32e5f3db triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:33.580899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:33.712899 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:33.841131 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56214) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:33.964505 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8731ae86-043a-4cb2-9872-94ab32e5f3db up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:34.052604 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.120327 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] For port 8731ae86-043a-4cb2-9872-94ab32e5f3db, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8731ae86-043a-4cb2-9872-94ab32e5f3db,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:34.174881 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 8731ae86-043a-4cb2-9872-94ab32e5f3db triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:34.174881 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.218601 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.287156 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.342767 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5096e19-c639-4cef-87dd-4fe24d751d29 None None] Pushing event updated for resources: {'Port': ['ID=8731ae86-043a-4cb2-9872-94ab32e5f3db,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:34.356864 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 3, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:34.390834 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Checking router: 25763a8c-3524-4cc2-b11e-226895f1ac53 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:34.391327 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Updating router 25763a8c-3524-4cc2-b11e-226895f1ac53 port 0535eb8a-a115-4960-a1f7-8c6251a0128c binding host dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:31:34.397919 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 136d5333-b159-4ef7-a144-e7d1ca8b998e up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:34.434636 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-de6abb35-6a80-4809-ace9-c23db5926eee None None] Provisioning complete for port 8731ae86-043a-4cb2-9872-94ab32e5f3db triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:34.435360 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-de6abb35-6a80-4809-ace9-c23db5926eee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.437714 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Deleting port 58fbfd6b-48a9-4541-9604-57788ed702f2 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:34.438577 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.465898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Allocated IP 172.20.0.1 (5da62686-a1fb-4288-ae81-9fdc2d8f7dd3/ca402e9d-3db8-40f8-baec-fffd914af1aa/6070f394-07a3-4f7c-bcc4-27f85a829749) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:31:34.474523 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.528556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.528889 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.542051 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Calling delete_port for 58fbfd6b-48a9-4541-9604-57788ed702f2 owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:34.574286 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.617114 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 136d5333-b159-4ef7-a144-e7d1ca8b998e triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:34.618046 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.679081 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.723937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:34.727444 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:34.730920 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:31:34.736512 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Pushing event updated for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:34.777864 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3810222'] for router_interface, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.862286 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks [] for port, precommit_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.933288 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:34.959151 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event deleted for resources: {'Port': ['ID=58fbfd6b-48a9-4541-9604-57788ed702f2,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:34.967444 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.019360 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.019993 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Floating IP 67b21a89-ff2c-4fcf-affc-d31122957bf0 disassociated (deleted). External IP: 172.27.2.205, port: f474946c-13d2-4ac8-a779-c93737b1fb02. Nov 24 16:31:35.033459 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Attempting to bind port 0535eb8a-a115-4960-a1f7-8c6251a0128c on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:35.033836 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Attempting to bind port 0535eb8a-a115-4960-a1f7-8c6251a0128c by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:35.034210 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Attempting to bind port 0535eb8a-a115-4960-a1f7-8c6251a0128c on network 03b2fe8c-76ac-4bca-971e-09f45230a994 {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:35.038622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0064e04-61b8-4b18-a933-c52b203f0da4 None None] Pushing event updated for resources: {'Port': ['ID=0535eb8a-a115-4960-a1f7-8c6251a0128c,revision_number=2']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:35.046484 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-70494b6d-fbbc-41c3-9833-b97497c2a1ea None None] Provisioning complete for port 6070f394-07a3-4f7c-bcc4-27f85a829749 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:35.046739 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-70494b6d-fbbc-41c3-9833-b97497c2a1ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.048549 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:35.048934 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Checking segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103143) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:35.049332 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.049732 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Bound using segment: {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'} {{(pid=103143) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:35.050212 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.managers [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Bound port: 0535eb8a-a115-4960-a1f7-8c6251a0128c, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '890dc0fb-5bd2-483a-82f2-fe5aa7d3675c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994'}}] {{(pid=103143) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:35.050592 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.092616 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.124112 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-70494b6d-fbbc-41c3-9833-b97497c2a1ea None None] Port 6070f394-07a3-4f7c-bcc4-27f85a829749 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:35.135877 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] For port 0535eb8a-a115-4960-a1f7-8c6251a0128c, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103143) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:35.140158 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] For port 0535eb8a-a115-4960-a1f7-8c6251a0128c, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0535eb8a-a115-4960-a1f7-8c6251a0128c,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:35.210845 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.259084 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:31:35.268142 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.271190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:35.271881 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:35.277453 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0064e04-61b8-4b18-a933-c52b203f0da4 None None] Pushing event updated for resources: {'Port': ['ID=0535eb8a-a115-4960-a1f7-8c6251a0128c,revision_number=3']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:35.324492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.379193 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:35.384337 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:35.386688 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.393916 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Sync routers for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:35.395537 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Pushing event updated for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:35.401304 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3641820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3810590'] for router_interface, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.409361 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:35.409962 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:35.419495 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-42be5c0a-c4f5-4200-85d1-d5689d859e9a tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "DELETE /v2.0/floatingips/67b21a89-ff2c-4fcf-affc-d31122957bf0 HTTP/1.1" status: 204 len: 168 time: 1.5774343 Nov 24 16:31:35.423158 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:31:35.423158 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe" -d '{"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:31:35.509727 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:31:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac8cbd8c-e2aa-48fa-8f9a-388b1ce6a27b x-openstack-request-id: req-ac8cbd8c-e2aa-48fa-8f9a-388b1ce6a27b {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:31:35.510323 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:31:35.511366 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-ac8cbd8c-e2aa-48fa-8f9a-388b1ce6a27b {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:31:35.511464 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'status': 'completed', 'code': 200} Nov 24 16:31:35.519761 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:31:35.521171 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:31:35.542541 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:35.645896 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-4db2f9c8-b354-4db4-b501-dc2d91c06052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:35.647500 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-4db2f9c8-b354-4db4-b501-dc2d91c06052 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 1098 time: 0.1145320 Nov 24 16:31:35.687611 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '6070f394-07a3-4f7c-bcc4-27f85a829749', 'name': '', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'mac_address': 'fa:16:3e:67:19:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:34Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 1, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'subnets': [{'id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:35.719130 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e615e842-584a-4330-a0a6-4b878551b47c None None] The sync data for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi is: [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '6070f394-07a3-4f7c-bcc4-27f85a829749', 'name': '', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'mac_address': 'fa:16:3e:67:19:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:34Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 1, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'subnets': [{'id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:35.795684 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Router 25763a8c-3524-4cc2-b11e-226895f1ac53 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:31:35.826827 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-371bdd3b-c34d-4dbc-895b-59fd80147cf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:35.828872 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-371bdd3b-c34d-4dbc-895b-59fd80147cf9 service neutron] 10.222.0.84 "GET /v2.0/networks?id=12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 200 len: 910 time: 0.1489999 Nov 24 16:31:35.849487 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8731ae86-043a-4cb2-9872-94ab32e5f3db up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:35.862104 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:35.898734 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Checking router: ea0a4f3c-ff9f-4435-88e9-7e33de04f220 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:35.907024 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:35.907886 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:35.913150 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-5dd6d30d-3ff3-4613-a5b7-180c8ae1fe5b None None] Provisioning complete for port 6070f394-07a3-4f7c-bcc4-27f85a829749 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:35.913418 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-5dd6d30d-3ff3-4613-a5b7-180c8ae1fe5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:35.919966 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-e266a6df-1043-4b29-bfb6-2b3d008b0f5a service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 200 len: 217 time: 0.0800748 Nov 24 16:31:35.973501 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 8731ae86-043a-4cb2-9872-94ab32e5f3db triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:35.974171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:36.005975 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-5dd6d30d-3ff3-4613-a5b7-180c8ae1fe5b None None] Port 6070f394-07a3-4f7c-bcc4-27f85a829749 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:36.035755 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:36.087093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-5695f486-963f-4e57-864a-30d1850c698e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:36.088771 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-5695f486-963f-4e57-864a-30d1850c698e service neutron] 10.222.0.84 "GET /v2.0/subnets?id=0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 200 len: 848 time: 0.1598315 Nov 24 16:31:36.104144 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:36.119019 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f06072a-72f2-4941-940f-c05559110b0c req-a7c7ddbc-d305-47cf-816d-ad22bc40dd18 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:36.123194 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f06072a-72f2-4941-940f-c05559110b0c req-a7c7ddbc-d305-47cf-816d-ad22bc40dd18 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.1309779 Nov 24 16:31:36.135201 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-dfc818fc-f23c-4f91-9b1e-45a4ddb19c84 admin admin] 10.222.0.82 "PUT /v2.0/routers/25763a8c-3524-4cc2-b11e-226895f1ac53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6143725 Nov 24 16:31:36.227574 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-c1044f36-5185-499b-adcd-d98650df8226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:36.229265 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-c1044f36-5185-499b-adcd-d98650df8226 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=12b56726-e7d3-442a-83b6-a1eb4c1c5936&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1232007 Nov 24 16:31:36.233452 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f06072a-72f2-4941-940f-c05559110b0c req-1a574a40-7809-403b-ba04-e0d180929c08 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1093695 Nov 24 16:31:36.332282 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:36.336887 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-fb35dd92-f8b2-4e51-b91c-2c5880fa7561 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926235 Nov 24 16:31:36.365638 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ed03e5f-e52d-42ef-973d-dca35f6cfa5a None None] The sync data for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi is: [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:26:07Z', 'revision_number': 4, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': 'a31284af-dc72-471c-afcc-148c4da2b1b7', 'name': '', 'network_id': '12b56726-e7d3-442a-83b6-a1eb4c1c5936', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'mac_address': 'fa:16:3e:66:0c:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:06Z', 'updated_at': '2021-11-24T16:26:11Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'subnets': [{'id': '0d71b5b1-1ef3-47d2-bee8-078251e998a9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:36.467374 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9f49e5a6-0fef-46be-b390-179bd0e0a9fe req-51bb8359-1606-4144-9104-7fc087d00cf7 service neutron] 10.222.0.84 "GET /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1195326 Nov 24 16:31:36.719092 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-199c136a-3de2-4125-b915-afab1b326240 None None] New status for floating IP 67b21a89-ff2c-4fcf-affc-d31122957bf0: DOWN {{(pid=103143) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:31:36.847786 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56232) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:36.853443 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1116717563', 'description': 'tempest-secgroup-smoke-1116717563 description', 'project_id': '3b37384f944943228da7761c28d2688c'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:36.939155 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.012267 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.095668 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.125956 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroup': ['ID=57111423-b7f2-4a51-99d9-39fc5eedc05d,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:37.198605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.199968 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2381d631-75fd-4ce4-9b21-5fc9c17ee74c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3510094 Nov 24 16:31:37.202830 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56234) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:37.207472 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:37.306779 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.357639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea049bc-71e5-49ff-8b25-2b2fa531473d req-68d1167f-2a23-4164-ada2-6e6bb5ee7281 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:37.359127 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6ea049bc-71e5-49ff-8b25-2b2fa531473d req-68d1167f-2a23-4164-ada2-6e6bb5ee7281 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0521011 Nov 24 16:31:37.366155 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.407563 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6ea049bc-71e5-49ff-8b25-2b2fa531473d req-c6b39e6b-42e1-41ed-b184-cbac3a0da139 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/security-groups?id=66a8af55-2ee6-4345-b62d-43183c79c046&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418391 Nov 24 16:31:37.432943 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.451478 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5d1a9ac-ed26-4748-9976-cc89c202cd4e,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:37.466150 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-4eb04e3c-32b7-4428-b1a6-60f38b172b6f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:37.471853 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-4eb04e3c-32b7-4428-b1a6-60f38b172b6f tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.84 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 945 time: 0.0519323 Nov 24 16:31:37.518153 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.519439 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-13f941d1-50ee-40d2-9aa0-f9b130e58e17 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3156400 Nov 24 16:31:37.522088 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56238) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:37.527363 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:37.564850 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Deleting port f474946c-13d2-4ac8-a779-c93737b1fb02 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:37.565189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.647094 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.653882 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] For port f474946c-13d2-4ac8-a779-c93737b1fb02, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=f474946c-13d2-4ac8-a779-c93737b1fb02,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:37.663094 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.667359 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Calling delete_port for f474946c-13d2-4ac8-a779-c93737b1fb02 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:37.706704 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.785104 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.791740 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0535eb8a-a115-4960-a1f7-8c6251a0128c up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:37.809638 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=010c9a09-f8a6-4677-a6f6-56160d60d0ef,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:37.840956 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0535eb8a-a115-4960-a1f7-8c6251a0128c triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:37.841328 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.876053 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.889814 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.893769 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d2796312-a240-41cd-8f19-57188edcf01a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3681972 Nov 24 16:31:37.894074 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56240) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:37.899160 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:37.905071 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event deleted for resources: {'Port': ['ID=f474946c-13d2-4ac8-a779-c93737b1fb02,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:37.923454 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.949905 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] For port 0535eb8a-a115-4960-a1f7-8c6251a0128c, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0535eb8a-a115-4960-a1f7-8c6251a0128c,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:37.956686 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] No DVR routers for this DVR port f474946c-13d2-4ac8-a779-c93737b1fb02 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:31:37.959252 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:37.963227 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8d61c426-fac2-4834-b4ea-9ce08b38a987 req-76e9da89-dc41-478e-9b4c-f56b0d9de1d7 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.84 "DELETE /v2.0/ports/f474946c-13d2-4ac8-a779-c93737b1fb02 HTTP/1.1" status: 204 len: 173 time: 0.4878271 Nov 24 16:31:37.963671 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-deleted', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:31:37.965958 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a15c799-23b2-442e-8d4e-e3b4966d4b17" -d '{"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-deleted", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:31:38.003926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.004190 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:31:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7072b0b3-088b-4897-b2f0-f1ba8b8356e3 x-openstack-request-id: req-7072b0b3-088b-4897-b2f0-f1ba8b8356e3 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:31:38.004483 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f487880-7b15-4350-86ae-8b03bd58bf29", "name": "network-vif-deleted", "tag": "f474946c-13d2-4ac8-a779-c93737b1fb02", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:31:38.004738 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-7072b0b3-088b-4897-b2f0-f1ba8b8356e3 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:31:38.005142 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f487880-7b15-4350-86ae-8b03bd58bf29', 'name': 'network-vif-deleted', 'tag': 'f474946c-13d2-4ac8-a779-c93737b1fb02', 'status': 'completed', 'code': 200} Nov 24 16:31:38.044477 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.062749 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.091900 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Pushing event updated for resources: {'Port': ['ID=0535eb8a-a115-4960-a1f7-8c6251a0128c,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:38.141156 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.159111 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a357a844-d5cc-4464-aa06-db7cb4f060e4,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:38.226423 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.228216 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-63c8a74c-7b09-4ea9-9397-f45d2b6dff2d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3330576 Nov 24 16:31:38.231150 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56244) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:38.236020 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:38.358707 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.430015 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.487499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.501170 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-27b74b7f-9490-46d6-81ee-434e23489b4b req-f45a8e06-1868-472b-8910-9cad92d39d49 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "GET /v2.0/ports?device_id=1f487880-7b15-4350-86ae-8b03bd58bf29 HTTP/1.1" status: 200 len: 210 time: 0.0260947 Nov 24 16:31:38.506721 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcf68522-229b-4bfd-8d94-d61035902ae7,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:38.575769 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.576910 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4d446c45-bde1-4dbd-8ea5-db1ae6ebc22a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3447518 Nov 24 16:31:38.579666 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56248) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:38.584074 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:38.656128 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Project 3b37384f944943228da7761c28d2688c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:31:38.661979 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.724342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.810232 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.828326 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a456e34d-d56c-4237-8be2-78bf49dda8e3,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:38.903592 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:38.904753 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-2d39bdcb-fbc5-4441-8f29-c9ef9c1bef0f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3240993 Nov 24 16:31:38.907532 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56250) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:38.911749 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'security_group_rule': {'security_group_id': '57111423-b7f2-4a51-99d9-39fc5eedc05d', 'project_id': '3b37384f944943228da7761c28d2688c', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:31:39.004404 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.securitygroups_db [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Project 3b37384f944943228da7761c28d2688c added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 16:31:39.009738 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.068204 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.147266 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-440460'] for security_group_rule, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.165714 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38c7b31e-c065-4752-9933-fd992585c81d,revision_number=0']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:39.252501 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.253785 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-ecdd3ec7-f274-4311-b1b4-9270d72ced52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3453305 Nov 24 16:31:39.422200 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Sync routers for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:39.432108 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:39.432801 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:39.561233 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56292) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:39.623839 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.627885 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:39.652751 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.774336 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0535eb8a-a115-4960-a1f7-8c6251a0128c up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:39.781800 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.784613 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Publish callbacks [] for security_group, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.785926 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] 10.222.0.82 "DELETE /v2.0/security-groups/66a8af55-2ee6-4345-b62d-43183c79c046 HTTP/1.1" status: 204 len: 168 time: 0.2236049 Nov 24 16:31:39.799360 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3719b9e-8857-4e87-b669-0f42b4c0ae77 tempest-TestShelveInstance-799534230 tempest-TestShelveInstance-799534230-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=66a8af55-2ee6-4345-b62d-43183c79c046,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:39.840755 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 0535eb8a-a115-4960-a1f7-8c6251a0128c triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:39.841151 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:39.844838 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '6070f394-07a3-4f7c-bcc4-27f85a829749', 'name': '', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'mac_address': 'fa:16:3e:67:19:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:34Z', 'updated_at': '2021-11-24T16:31:35Z', 'revision_number': 2, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'subnets': [{'id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:39.882006 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Checking router: 25763a8c-3524-4cc2-b11e-226895f1ac53 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:39.882127 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Updating router 25763a8c-3524-4cc2-b11e-226895f1ac53 port 6070f394-07a3-4f7c-bcc4-27f85a829749 binding host dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 16:31:39.899337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56296) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:39.913941 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.200953 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks [] for port, precommit_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.295636 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.348167 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba46c7f5-5067-4123-9c07-11c20105f2ce None None] Pushing event updated for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=3']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:40.349231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.401376 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Attempting to bind port 6070f394-07a3-4f7c-bcc4-27f85a829749 on host dv-cinder-819007-2-iscsi for vnic_type normal with profile {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:31:40.402187 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Attempting to bind port 6070f394-07a3-4f7c-bcc4-27f85a829749 by drivers openvswitch,hyperv on host dv-cinder-819007-2-iscsi at level 0 using segments [{'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:31:40.402187 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Attempting to bind port 6070f394-07a3-4f7c-bcc4-27f85a829749 on network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:31:40.407553 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Checking agent: {'id': '51b4eba8-3f9c-41b3-b7a3-940e2be42a34', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819007-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 14, 22), 'started_at': datetime.datetime(2021, 11, 24, 16, 14, 52), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819007-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:31:40.407932 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Checking segment: {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103144) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:31:40.408335 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.408751 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Bound using segment: {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'} {{(pid=103144) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:31:40.409219 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.managers [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Bound port: 6070f394-07a3-4f7c-bcc4-27f85a829749, host: dv-cinder-819007-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16ac500b-6232-434f-893b-d3baa2e29d82', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3'}}] {{(pid=103144) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:31:40.409617 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.481935 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] For port 6070f394-07a3-4f7c-bcc4-27f85a829749, host dv-cinder-819007-2-iscsi, cleared binding levels {{(pid=103144) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:31:40.488869 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.plugins.ml2.db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] For port 6070f394-07a3-4f7c-bcc4-27f85a829749, host dv-cinder-819007-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=6070f394-07a3-4f7c-bcc4-27f85a829749,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103144) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:31:40.570937 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-be7def72-413a-4862-8cc2-3b96836c120c None None] Provisioning complete for port 6070f394-07a3-4f7c-bcc4-27f85a829749 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:40.571311 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-be7def72-413a-4862-8cc2-3b96836c120c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.576497 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron_lib.callbacks.manager [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103144) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.609007 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-be7def72-413a-4862-8cc2-3b96836c120c None None] Port 6070f394-07a3-4f7c-bcc4-27f85a829749 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:31:40.630922 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:40.631923 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:40.644838 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Deleting port a31284af-dc72-471c-afcc-148c4da2b1b7 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:40.645172 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.708929 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba46c7f5-5067-4123-9c07-11c20105f2ce None None] Pushing event updated for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=4']} {{(pid=103144) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:40.738030 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] For port a31284af-dc72-471c-afcc-148c4da2b1b7, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a31284af-dc72-471c-afcc-148c4da2b1b7,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:40.738391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:40.753450 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Calling delete_port for a31284af-dc72-471c-afcc-148c4da2b1b7 owned by network:router_interface {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:40.781755 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:40.930424 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] Provisioning complete for port 6070f394-07a3-4f7c-bcc4-27f85a829749 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:40.931023 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.009326 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-38983e7e-c942-4ccb-af78-778022206756 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '6070f394-07a3-4f7c-bcc4-27f85a829749', 'name': '', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'mac_address': 'fa:16:3e:67:19:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:34Z', 'updated_at': '2021-11-24T16:31:40Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'subnets': [{'id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:41.010035 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.017303 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.036041 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38983e7e-c942-4ccb-af78-778022206756 None None] The sync data for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi is: [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:31:34Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '6070f394-07a3-4f7c-bcc4-27f85a829749', 'name': '', 'network_id': '5da62686-a1fb-4288-ae81-9fdc2d8f7dd3', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'mac_address': 'fa:16:3e:67:19:b4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:34Z', 'updated_at': '2021-11-24T16:31:40Z', 'revision_number': 4, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'subnets': [{'id': 'ca402e9d-3db8-40f8-baec-fffd914af1aa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:41.036906 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Pushing event deleted for resources: {'Port': ['ID=a31284af-dc72-471c-afcc-148c4da2b1b7,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:41.067392 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] For port 6070f394-07a3-4f7c-bcc4-27f85a829749, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=6070f394-07a3-4f7c-bcc4-27f85a829749,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:41.139206 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.219076 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c900726b-cc1f-4346-bcc3-e2ee935f36ab None None] Pushing event updated for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:41.263754 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.495454 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:31:41.608805 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:41.617505 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-94f1c620-7721-43a3-bf38-24ffe4c2ae8d admin admin] 10.222.0.82 "PUT /v2.0/routers/ea0a4f3c-ff9f-4435-88e9-7e33de04f220/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7135682 Nov 24 16:31:41.617505 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56320) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:41.620367 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Sync routers for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:41.639564 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:41.640195 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:41.699889 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:41.740776 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.752124 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: f474946c-13d2-4ac8-a779-c93737b1fb02 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:41.752714 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device f474946c-13d2-4ac8-a779-c93737b1fb02 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:41.790027 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:41.862551 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:41.914238 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 6070f394-07a3-4f7c-bcc4-27f85a829749 up at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:31:41.997314 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Deleting port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:41.997657 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.009666 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Provisioning complete for port 6070f394-07a3-4f7c-bcc4-27f85a829749 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:31:42.010190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.066815 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106'}], 'enable_snat': True}, 'gw_port_id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:31:40Z', 'revision_number': 5, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port': {'id': 'd4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:01:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'device_owner': 'network:router_gateway', 'standard_attr_id': 450, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:04Z', 'updated_at': '2021-11-24T16:26:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:42.104799 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Checking router: ea0a4f3c-ff9f-4435-88e9-7e33de04f220 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:42.142331 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Routers {'ea0a4f3c-ff9f-4435-88e9-7e33de04f220'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:42.143006 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:42.247516 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] Set router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 gateway port host: None {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:42.305547 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:31:41Z', 'revision_number': 6, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:42.337192 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2fc12a42-23c1-4ba8-8154-9d3051d814c3 None None] The sync data for ids ['ea0a4f3c-ff9f-4435-88e9-7e33de04f220'] in dv-cinder-819007-2-iscsi is: [{'id': 'ea0a4f3c-ff9f-4435-88e9-7e33de04f220', 'name': 'tempest-TestShelveInstance-1892691750-router', 'tenant_id': '34cb226439404c1cbbca2f36b3d8bec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:03Z', 'updated_at': '2021-11-24T16:31:41Z', 'revision_number': 6, 'project_id': '34cb226439404c1cbbca2f36b3d8bec4', 'gw_port_host': None}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:42.350563 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] For port d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:42.351132 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.364642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Calling delete_port for d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:42.602528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.627989 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Pushing event deleted for resources: {'Port': ['ID=d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:42.691467 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.788190 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.790464 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.899572 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.900075 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ea0a4f3c-ff9f-4435-88e9-7e33de04f220 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:31:42.904905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.906061 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e28f3c27-12eb-4eea-bcf1-4e9506e8c9b1 admin admin] 10.222.0.82 "DELETE /v2.0/routers/ea0a4f3c-ff9f-4435-88e9-7e33de04f220 HTTP/1.1" status: 204 len: 168 time: 1.2885725 Nov 24 16:31:42.908570 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56324) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:42.953263 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Deleting subnet 0d71b5b1-1ef3-47d2-bee8-078251e998a9 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:31:42.956413 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:42.991237 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.073082 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.197087 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.226056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.232444 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d980b8cb-df0d-4ab2-9c9b-56b1bf2ab82d None None] Network 12b56726-e7d3-442a-83b6-a1eb4c1c5936 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:43.233444 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56328) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:43.234128 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/0d71b5b1-1ef3-47d2-bee8-078251e998a9 HTTP/1.1" status: 204 len: 168 time: 0.3241112 Nov 24 16:31:43.234828 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7072e9df-ef2a-4eeb-9ad5-306a2c8bb065 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0d71b5b1-1ef3-47d2-bee8-078251e998a9,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:43.323742 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.379022 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Deleting port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:43.379390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.447553 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] For port b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,segment=NetworkSegment(7d803832-b892-4b8c-b302-2e5f6c49e7b3),segment_id=7d803832-b892-4b8c-b302-2e5f6c49e7b3)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:43.447854 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.459868 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Calling delete_port for b6fcc8a5-7b67-42ea-bec7-0807401b3d74 owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:43.585090 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] DHCP port deletion for 12b56726-e7d3-442a-83b6-a1eb4c1c5936 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:31:43.604642 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.630949 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:43.633657 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Deleting port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:43.634587 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.635158 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] No DVR routers for this DVR port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:31:43.715591 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] For port b6fcc8a5-7b67-42ea-bec7-0807401b3d74, host dv-cinder-819007-2-iscsi, got binding levels [] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:43.716211 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.719588 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.753699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Calling delete_port for b6fcc8a5-7b67-42ea-bec7-0807401b3d74 owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:43.758640 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.ipam_backend_mixin [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 was not found and therefore no delete operation was performed {{(pid=103143) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 24 16:31:43.764706 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.768527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12b56726-e7d3-442a-83b6-a1eb4c1c5936']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:43.784844 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7d803832-b892-4b8c-b302-2e5f6c49e7b3') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:43.785211 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7d803832-b892-4b8c-b302-2e5f6c49e7b3') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:43.797436 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] Pushing event deleted for resources: {'Port': ['ID=b6fcc8a5-7b67-42ea-bec7-0807401b3d74,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:43.805146 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fff9db4-eec3-43ee-9978-6cc88a69c28f None None] No DVR routers for this DVR port b6fcc8a5-7b67-42ea-bec7-0807401b3d74 on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:31:43.818642 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.837591 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.844329 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Releasing vlan 893 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:31:43.844736 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:31:43.846553 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:31:44.002015 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:44.012556 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:44.012556 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] 10.222.0.82 "DELETE /v2.0/networks/12b56726-e7d3-442a-83b6-a1eb4c1c5936 HTTP/1.1" status: 204 len: 168 time: 0.7774937 Nov 24 16:31:44.015638 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56330) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:44.021215 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068fc846-7e6a-479b-a2ee-7eefe545e6a4 admin admin] Pushing event deleted for resources: {'Network': ['ID=12b56726-e7d3-442a-83b6-a1eb4c1c5936,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:44.199016 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a31284af-dc72-471c-afcc-148c4da2b1b7 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:44.224250 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: a31284af-dc72-471c-afcc-148c4da2b1b7 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:44.224626 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a31284af-dc72-471c-afcc-148c4da2b1b7 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:44.225008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b6fcc8a5-7b67-42ea-bec7-0807401b3d74 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:44.247992 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: b6fcc8a5-7b67-42ea-bec7-0807401b3d74 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:44.248707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b6fcc8a5-7b67-42ea-bec7-0807401b3d74 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:44.380429 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:44.630588 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Deleting port a8684d21-fddf-4b9c-b792-3202a29d136d {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:44.630837 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:44.710170 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] For port a8684d21-fddf-4b9c-b792-3202a29d136d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=a8684d21-fddf-4b9c-b792-3202a29d136d,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:44.710531 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:44.725838 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Calling delete_port for a8684d21-fddf-4b9c-b792-3202a29d136d owned by network:router_interface {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:44.975716 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.000482 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Pushing event deleted for resources: {'Port': ['ID=a8684d21-fddf-4b9c-b792-3202a29d136d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:45.176512 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.397329 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Router 109af11a-ca44-4cd0-85ea-eeae78683a05 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:31:45.504878 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:31:45.510052 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-2ed4add8-6fd4-44b3-9112-a713678690bc admin admin] 10.222.0.82 "PUT /v2.0/routers/109af11a-ca44-4cd0-85ea-eeae78683a05/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4933226 Nov 24 16:31:45.512492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56336) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:45.515000 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Sync routers for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:31:45.525517 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:45.526121 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:45.619163 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.631911 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:45.731179 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.781937 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:45.804231 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:45.804574 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device d4d8f1bc-50e6-423c-a5cf-07d3dd11a1a5 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:45.827496 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82'}], 'enable_snat': True}, 'gw_port_id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:31:44Z', 'revision_number': 5, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port': {'id': '3a54d76d-c657-4cb9-935d-c5298f72182e', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:62:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 462, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.82', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:26:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:45.846900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Deleting port 3a54d76d-c657-4cb9-935d-c5298f72182e {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:45.847483 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.856153 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Checking router: 109af11a-ca44-4cd0-85ea-eeae78683a05 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:31:45.864449 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Routers {'109af11a-ca44-4cd0-85ea-eeae78683a05'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:31:45.865054 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['109af11a-ca44-4cd0-85ea-eeae78683a05'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:45.926309 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] For port 3a54d76d-c657-4cb9-935d-c5298f72182e, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=3a54d76d-c657-4cb9-935d-c5298f72182e,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:45.926629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:45.939403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Calling delete_port for 3a54d76d-c657-4cb9-935d-c5298f72182e owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:45.953496 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] Set router 109af11a-ca44-4cd0-85ea-eeae78683a05 gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:31:46.005207 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:31:45Z', 'revision_number': 6, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:46.034994 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2cf42fd7-5da0-45d1-9320-51ee545731f3 None None] The sync data for ids ['109af11a-ca44-4cd0-85ea-eeae78683a05'] in dv-cinder-819007-2-iscsi is: [{'id': '109af11a-ca44-4cd0-85ea-eeae78683a05', 'name': 'tempest-TestShelveInstance-286564106-router', 'tenant_id': 'b06295b6eebe467eb9949f985d105c3d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:26:10Z', 'updated_at': '2021-11-24T16:31:45Z', 'revision_number': 6, 'project_id': 'b06295b6eebe467eb9949f985d105c3d', 'gw_port_host': None}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:31:46.163965 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.189830 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Pushing event deleted for resources: {'Port': ['ID=3a54d76d-c657-4cb9-935d-c5298f72182e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:46.252729 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.343368 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.345397 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.449646 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.453411 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 109af11a-ca44-4cd0-85ea-eeae78683a05 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:31:46.456911 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.458163 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9731693c-0d1d-4ea2-8083-cf23ae184084 admin admin] 10.222.0.82 "DELETE /v2.0/routers/109af11a-ca44-4cd0-85ea-eeae78683a05 HTTP/1.1" status: 204 len: 168 time: 0.9447525 Nov 24 16:31:46.461373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56340) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:46.511516 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Deleting subnet 129ce7ff-19a3-437b-a2b6-0854834cc7d6 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:31:46.514529 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.549634 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.625703 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.741796 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.769859 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=129ce7ff-19a3-437b-a2b6-0854834cc7d6,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:46.775948 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.779306 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3ff319e9-0875-4323-80bf-84ccdbeaf05a admin admin] 10.222.0.82 "DELETE /v2.0/subnets/129ce7ff-19a3-437b-a2b6-0854834cc7d6 HTTP/1.1" status: 204 len: 168 time: 0.3169672 Nov 24 16:31:46.781905 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56342) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:46.788208 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69dcba20-7b4b-4753-8a48-2fe9b7af9d00 None None] Network 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:31:46.868989 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.919279 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6321cf35-4854-4d63-8db6-dad3e5d60af1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.926775 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Deleting port 9396411f-89ad-414a-abc7-f1d8d02f012f {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:46.927212 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:46.994769 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] DHCP port deletion for 6644be78-52ee-4cbb-add6-7a7dbcbc29c8 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:31:46.999123 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] For port 9396411f-89ad-414a-abc7-f1d8d02f012f, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9396411f-89ad-414a-abc7-f1d8d02f012f,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:46.999688 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.017794 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Calling delete_port for 9396411f-89ad-414a-abc7-f1d8d02f012f owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:47.051269 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Deleting port 9396411f-89ad-414a-abc7-f1d8d02f012f {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:31:47.051636 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.118633 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] For port 9396411f-89ad-414a-abc7-f1d8d02f012f, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=9396411f-89ad-414a-abc7-f1d8d02f012f,segment=NetworkSegment(d35b9ee2-f009-4a81-970c-aa53418e6d7f),segment_id=d35b9ee2-f009-4a81-970c-aa53418e6d7f)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:31:47.119080 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.136843 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Calling delete_port for 9396411f-89ad-414a-abc7-f1d8d02f012f owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:31:47.152669 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.180468 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Pushing event deleted for resources: {'Port': ['ID=9396411f-89ad-414a-abc7-f1d8d02f012f,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:47.185032 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] No DVR routers for this DVR port 9396411f-89ad-414a-abc7-f1d8d02f012f on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:31:47.216628 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.240008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] Pushing event deleted for resources: {'Port': ['ID=9396411f-89ad-414a-abc7-f1d8d02f012f,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:47.245547 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78b9449a-89bc-4107-8661-05672db517b4 None None] No DVR routers for this DVR port 9396411f-89ad-414a-abc7-f1d8d02f012f on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:31:47.261684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.281725 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6644be78-52ee-4cbb-add6-7a7dbcbc29c8']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:47.291291 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd35b9ee2-f009-4a81-970c-aa53418e6d7f') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:47.291583 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd35b9ee2-f009-4a81-970c-aa53418e6d7f') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:31:47.300579 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.313099 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.319243 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Releasing vlan 869 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:31:47.319680 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:31:47.321846 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:31:47.458836 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.465684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:47.468868 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] 10.222.0.82 "DELETE /v2.0/networks/6644be78-52ee-4cbb-add6-7a7dbcbc29c8 HTTP/1.1" status: 204 len: 168 time: 0.6858582 Nov 24 16:31:47.483031 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e66a933-fd12-44b1-8dfa-870e999da7e5 admin admin] Pushing event deleted for resources: {'Network': ['ID=6644be78-52ee-4cbb-add6-7a7dbcbc29c8,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:47.775212 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a8684d21-fddf-4b9c-b792-3202a29d136d no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:47.795008 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: a8684d21-fddf-4b9c-b792-3202a29d136d {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:47.795630 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device a8684d21-fddf-4b9c-b792-3202a29d136d not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:47.795754 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9396411f-89ad-414a-abc7-f1d8d02f012f no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:47.829759 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56348) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:47.946346 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 9396411f-89ad-414a-abc7-f1d8d02f012f {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:47.946701 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 9396411f-89ad-414a-abc7-f1d8d02f012f not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:47.947127 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 3a54d76d-c657-4cb9-935d-c5298f72182e no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:31:47.966930 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 3a54d76d-c657-4cb9-935d-c5298f72182e {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:31:47.967313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 3a54d76d-c657-4cb9-935d-c5298f72182e not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:31:48.134320 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-125a6a1e-f27b-43fb-bfa1-212c7052da6b admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=34cb226439404c1cbbca2f36b3d8bec4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3032141 Nov 24 16:31:48.136693 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56350) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:48.184539 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:48.205908 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:48.321825 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:48.324497 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:48.325646 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/1b1cf0bc-88ab-436f-a81e-15e1e11538fa HTTP/1.1" status: 204 len: 168 time: 0.1880658 Nov 24 16:31:48.333279 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b01e443-5fbd-4c5a-9a57-d6d3f770eab9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b1cf0bc-88ab-436f-a81e-15e1e11538fa,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:49.014554 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56358) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:49.054054 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-a0fd02e2-abb1-4052-bbd9-abc00ca3eb2e admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=b06295b6eebe467eb9949f985d105c3d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382781 Nov 24 16:31:49.056545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56360) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:31:49.105184 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:49.127321 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:49.243954 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:49.248401 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:49.248401 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/f09b7144-34ac-4a74-a0ee-cb72745b8884 HTTP/1.1" status: 204 len: 168 time: 0.1903293 Nov 24 16:31:49.255840 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea91c61c-ef75-48fc-a2f5-d577655df80c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f09b7144-34ac-4a74-a0ee-cb72745b8884,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:31:49.269674 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-94cf1bd0-c212-4743-912f-eb617551cb73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:50.369564 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:51.729631 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:52.409369 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:57.169045 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4f5a59d3-e2f1-4950-8611-8d35ca16e408 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1116717563&fields=id&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 267 time: 0.0434551 Nov 24 16:31:57.270693 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-545d510a-6f72-4f8a-8e08-adc10815892b tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:31:57.272176 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-545d510a-6f72-4f8a-8e08-adc10815892b tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.0967803 Nov 24 16:31:57.292333 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-f2ecd527-250a-4502-b769-56723347e4d6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/quotas/3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 375 time: 0.0109723 Nov 24 16:31:57.348239 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-ce20caeb-00d8-46cc-ba34-aa6326eba5e8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0504098 Nov 24 16:31:57.441053 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-b048522b-fb3e-4d64-8f2e-284641d83793 service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807362 Nov 24 16:31:57.532190 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-d35fc577-69c3-4835-acae-d6de6776cc0a service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847085 Nov 24 16:31:58.084599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-4b492f63-8b96-4fd9-8561-9e3a8231c6c1 req-5ed5ee92-627f-4a77-93b6-550efdc5abfd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 210 time: 0.0259855 Nov 24 16:31:59.106992 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:31:59.175375 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f2eb2c08-811b-4a10-84aa-5963df187b21 req-ce9b62b1-107d-4bd5-bd83-353b66832fed tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 210 time: 0.0252485 Nov 24 16:32:00.201995 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-a33a7244-1128-42e8-9350-d1bbbf5d1fe6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:00.203512 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-a33a7244-1128-42e8-9350-d1bbbf5d1fe6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.1014371 Nov 24 16:32:00.283877 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cb8470bb-1fb1-49bd-bc92-90012429483c req-1b49d308-3ef0-45e3-a428-4b2cb04a84cc tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 210 time: 0.0346298 Nov 24 16:32:00.289683 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4d72a209-cf63-4cd5-a93a-765959c336e3 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 380 time: 0.0763834 Nov 24 16:32:00.300051 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'port': {'device_id': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'admin_state_up': True, 'tenant_id': '3b37384f944943228da7761c28d2688c', 'security_groups': ['57111423-b7f2-4a51-99d9-39fc5eedc05d']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:32:00.495189 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Made reservation on behalf of 3b37384f944943228da7761c28d2688c for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:32:00.498778 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:00.622496 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.20.0.12 (d5daf004-999b-4292-8917-46525a8f363e/ed51ff75-126f-45c3-ab4f-52644e5c0709/9d306c33-58a6-46b4-9ff6-763c1d82d7b6) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:32:00.763736 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:00.844031 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:00.889224 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:32:00.892074 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:32:00.895787 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:32:00.902387 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:00.951469 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:00.959568 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.052160 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-4580cc1b-31b5-4616-add6-90c96c436392 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7559321 Nov 24 16:32:01.075251 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Request body: {'port': {'device_id': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:32:01.092837 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-4b8328dc-893f-42a2-a77c-6c448c9d46c7 None None] Provisioning complete for port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:32:01.093464 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4b8328dc-893f-42a2-a77c-6c448c9d46c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.132171 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-4b8328dc-893f-42a2-a77c-6c448c9d46c7 None None] Port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:32:01.144934 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.408750 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:32:01.416866 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.422790 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee72251-dae7-4d88-bcda-af7f0f33d871 req-7e1cb71a-f0de-4deb-845d-ef9e31b21854 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:01.424931 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aee72251-dae7-4d88-bcda-af7f0f33d871 req-7e1cb71a-f0de-4deb-845d-ef9e31b21854 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 932 time: 0.0729861 Nov 24 16:32:01.429178 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Transition to ACTIVE for port object 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:32:01.474150 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-aee72251-dae7-4d88-bcda-af7f0f33d871 req-c49e7884-bf3f-4d90-b478-642dd483af80 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438032 Nov 24 16:32:01.521497 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.577849 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Pushing event updated for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:01.643031 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Attempting to bind port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:32:01.643374 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Attempting to bind port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:32:01.643730 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Attempting to bind port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:32:01.648396 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 on network d5daf004-999b-4292-8917-46525a8f363e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:32:01.648719 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Attempting to bind port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:32:01.654557 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 31, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:32:01.654898 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:32:01.655323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Bound using segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:32:01.655760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Bound port: 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:32:01.656119 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.721200 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:32:01.724823 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:32:01.821198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.859433 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:01.860060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:01.861452 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] 10.222.0.84 "PUT /v2.0/ports/9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 200 len: 1094 time: 0.7924714 Nov 24 16:32:01.861890 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:32:01.864183 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60" -d '{"events": [{"name": "network-changed", "server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:32:01.891662 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd6078e-d3bb-4e6d-ba48-f7191225df58 service neutron] Pushing event updated for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:01.906060 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:32:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d320f15-1d68-44ed-b259-80a560e33eba x-openstack-request-id: req-2d320f15-1d68-44ed-b259-80a560e33eba {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:32:01.906381 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:32:01.906620 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2d320f15-1d68-44ed-b259-80a560e33eba {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:32:01.907081 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'status': 'completed', 'code': 200} Nov 24 16:32:01.976034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-74b01b30-4e19-4e83-a659-7e84571a5f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:01.977563 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-74b01b30-4e19-4e83-a659-7e84571a5f2a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1097 time: 0.0441239 Nov 24 16:32:02.083471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-9f0aba69-f014-4de6-9dea-dfdac612028d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.085214 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-9f0aba69-f014-4de6-9dea-dfdac612028d service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=3b37384f944943228da7761c28d2688c&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0983419 Nov 24 16:32:02.182474 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-1a664392-3f02-4acc-8d95-f2f88338a674 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.183864 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7b4d7891-68c1-4e7c-886a-6ae5562d0b60 req-1a664392-3f02-4acc-8d95-f2f88338a674 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0921555 Nov 24 16:32:02.266853 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-a8fd0b1a-81e6-416a-85b6-a4d751eec3c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.268378 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-a8fd0b1a-81e6-416a-85b6-a4d751eec3c8 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1097 time: 0.0407097 Nov 24 16:32:02.315132 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-adad1ed8-0beb-4be8-9f8e-8ad04e06c61c service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 200 len: 217 time: 0.0373843 Nov 24 16:32:02.363622 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-313de70d-e771-47a3-b477-9a21660f394d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.365035 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-313de70d-e771-47a3-b477-9a21660f394d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0428047 Nov 24 16:32:02.409110 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-f48467fb-3e83-4519-b6a7-26a6f10809b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.410564 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-f48467fb-3e83-4519-b6a7-26a6f10809b0 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0380290 Nov 24 16:32:02.504339 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-0643626e-8495-4423-b961-b4786f1b0581 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849440 Nov 24 16:32:02.594002 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ae1640-44dc-481e-b5d4-506ef695b66d req-168888be-0a36-4621-b3ae-13eb0b4fd8eb tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:02.595561 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-c09fc5a2-e277-4187-8c3b-76fd494a5f1e req-31ad106f-5924-4c3a-a801-997130ce1c94 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834000 Nov 24 16:32:02.595710 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-97ae1640-44dc-481e-b5d4-506ef695b66d req-168888be-0a36-4621-b3ae-13eb0b4fd8eb tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0527682 Nov 24 16:32:02.644709 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-97ae1640-44dc-481e-b5d4-506ef695b66d req-de11fa0e-eb43-410a-965f-1c93cad07065 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427217 Nov 24 16:32:03.765443 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-482cf56d-ba04-427b-aa9c-a0e5e7e2901b req-0e16f8e4-47cd-447f-ab29-b18341d4fbe2 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:03.766892 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-482cf56d-ba04-427b-aa9c-a0e5e7e2901b req-0e16f8e4-47cd-447f-ab29-b18341d4fbe2 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0529799 Nov 24 16:32:03.820393 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-482cf56d-ba04-427b-aa9c-a0e5e7e2901b req-34e4700a-7450-4893-b94f-a79981283625 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475876 Nov 24 16:32:04.930447 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24aa6dbe-b261-408f-9aa0-3fbbeb0f6bdb req-c5d078e6-938d-4ab2-aa18-3ea096844d63 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:04.932565 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-24aa6dbe-b261-408f-9aa0-3fbbeb0f6bdb req-c5d078e6-938d-4ab2-aa18-3ea096844d63 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0480509 Nov 24 16:32:04.980372 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-24aa6dbe-b261-408f-9aa0-3fbbeb0f6bdb req-dd4cf1bf-3323-4d03-8a86-5ae392f1f3ed tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413027 Nov 24 16:32:06.091455 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9746261b-9120-4c9f-9d42-817ba8b33fe9 req-148fe291-6629-4236-aa97-868a2524395c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:06.092915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9746261b-9120-4c9f-9d42-817ba8b33fe9 req-148fe291-6629-4236-aa97-868a2524395c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0478840 Nov 24 16:32:06.141599 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-9746261b-9120-4c9f-9d42-817ba8b33fe9 req-c02dfa28-b61d-4b8f-8f86-de0fbea5f44c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428860 Nov 24 16:32:06.148936 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:32:07.255342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a333455-39a3-4b4f-9203-13b802482909 req-b2abe68d-bce2-4dc0-84f6-3c1c8219b420 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:07.256794 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1a333455-39a3-4b4f-9203-13b802482909 req-b2abe68d-bce2-4dc0-84f6-3c1c8219b420 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0502422 Nov 24 16:32:07.303935 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1a333455-39a3-4b4f-9203-13b802482909 req-6341ea38-1ff3-43c4-af09-9a3e25b7a471 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407541 Nov 24 16:32:08.416352 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bccbc98-ca85-40e1-a2e1-fa56c7bbe1d7 req-1ac9171c-01ed-4083-829d-f6829ba137a7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:08.417766 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bccbc98-ca85-40e1-a2e1-fa56c7bbe1d7 req-1ac9171c-01ed-4083-829d-f6829ba137a7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0471373 Nov 24 16:32:08.468378 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bccbc98-ca85-40e1-a2e1-fa56c7bbe1d7 req-2c2932e0-e994-48d8-aa69-fafffa606517 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448399 Nov 24 16:32:09.580010 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44174f5-fc39-414e-afb2-fdffb9826877 req-f4d4f60a-3a30-45d3-92ab-a72d9422195d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:09.581501 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c44174f5-fc39-414e-afb2-fdffb9826877 req-f4d4f60a-3a30-45d3-92ab-a72d9422195d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 944 time: 0.0481472 Nov 24 16:32:09.630600 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-c44174f5-fc39-414e-afb2-fdffb9826877 req-1dc8687c-62ad-4390-932e-d056485aaaf5 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430498 Nov 24 16:32:09.840016 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:32:09.931684 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:32:09.946018 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'port_id': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'mac_address': 'fa:16:3e:ff:e3:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:32:09.982286 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:09.996048 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:32:10.015907 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:32:10.069862 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:10.118080 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:10.283577 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['9d306c33-58a6-46b4-9ff6-763c1d82d7b6'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:32:10.741545 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324e3e4e-fdfd-4281-8447-7b3cadaca2f6 req-af1e76f7-1908-4fc6-80c2-f70a3ad8cc87 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:10.742991 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-324e3e4e-fdfd-4281-8447-7b3cadaca2f6 req-af1e76f7-1908-4fc6-80c2-f70a3ad8cc87 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 945 time: 0.0467708 Nov 24 16:32:10.790319 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-324e3e4e-fdfd-4281-8447-7b3cadaca2f6 req-ca326790-6710-45b5-9d6a-22508212b49d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409567 Nov 24 16:32:11.851706 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:32:11.904159 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f807622f-b4ad-456f-80f7-5afe36cee41d req-453e3503-dd6c-4ced-8ce6-c78a049e3583 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:11.908547 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f807622f-b4ad-456f-80f7-5afe36cee41d req-453e3503-dd6c-4ced-8ce6-c78a049e3583 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 945 time: 0.0482881 Nov 24 16:32:11.955229 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:32:11.957990 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f807622f-b4ad-456f-80f7-5afe36cee41d req-5b39ed9d-37e7-4993-adca-8a01a4818290 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463989 Nov 24 16:32:11.959339 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:32:11.959718 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:12.040686 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:12.062644 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:32:12.064982 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb9b00bd-5e25-4052-9abb-82ddade1d29f" -d '{"events": [{"server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "name": "network-vif-plugged", "status": "completed", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:32:12.079231 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:32:12.100876 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:32:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e78cf39-16de-4c92-b681-ff5c2980ee12 x-openstack-request-id: req-2e78cf39-16de-4c92-b681-ff5c2980ee12 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:32:12.101175 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "name": "network-vif-plugged", "status": "completed", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:32:12.101443 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-2e78cf39-16de-4c92-b681-ff5c2980ee12 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:32:12.101970 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'code': 200} Nov 24 16:32:12.157505 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:12.204066 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:12.514823 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b619416-c57a-4b7a-9f5b-98144ded57cb req-05d99fab-b281-47a3-ba36-5f5d18878075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:12.516356 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b619416-c57a-4b7a-9f5b-98144ded57cb req-05d99fab-b281-47a3-ba36-5f5d18878075 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1099 time: 0.0391984 Nov 24 16:32:12.561792 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-3b619416-c57a-4b7a-9f5b-98144ded57cb req-5e4d2439-f53c-4445-bb82-fd98e4ed0d6c service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380640 Nov 24 16:32:13.075027 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54430261-476f-495a-b58c-dc2b2051b913 req-e8825c0d-6202-4b76-8f17-f1aa33559884 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:13.076501 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-54430261-476f-495a-b58c-dc2b2051b913 req-e8825c0d-6202-4b76-8f17-f1aa33559884 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.0469723 Nov 24 16:32:13.124879 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-54430261-476f-495a-b58c-dc2b2051b913 req-300dc8fb-9559-47be-afaa-f9872b3b2c55 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425656 Nov 24 16:32:14.246639 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb45b35-afb2-4f2a-b56f-c64006983b4b req-f1f2f939-ad93-42a0-bf91-e4becb73b4d7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:14.248140 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8eb45b35-afb2-4f2a-b56f-c64006983b4b req-f1f2f939-ad93-42a0-bf91-e4becb73b4d7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.0549488 Nov 24 16:32:14.296173 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8eb45b35-afb2-4f2a-b56f-c64006983b4b req-c9bfb78a-e88e-48f7-aed4-15e378492a25 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420246 Nov 24 16:32:14.405424 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb88914b-ffcc-41b6-907c-cc061c7fc8c2 req-d0b62e5a-6e70-4826-9d5d-f4edd15581c5 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:14.406820 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-eb88914b-ffcc-41b6-907c-cc061c7fc8c2 req-d0b62e5a-6e70-4826-9d5d-f4edd15581c5 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.0471618 Nov 24 16:32:14.454402 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-eb88914b-ffcc-41b6-907c-cc061c7fc8c2 req-e9753b96-85dc-49ee-8419-1b487b5c60e7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419075 Nov 24 16:32:14.475632 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56450) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:32:14.659644 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91a86df9-a2b8-4b48-9192-5f89970cc721 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:14.661042 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-91a86df9-a2b8-4b48-9192-5f89970cc721 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1094 time: 0.1844642 Nov 24 16:32:14.664108 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56454) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:32:14.668815 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'port_id': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:32:14.743823 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:14.837931 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:14.941777 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.27.2.221 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/5698d8d0-b76b-461e-978b-d3c856fbcb36) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:32:15.038532 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.149819 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.192436 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:32:15.195116 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:32:15.198478 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:32:15.203699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=5698d8d0-b76b-461e-978b-d3c856fbcb36,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:15.539221 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.677507 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.825419 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.882842 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:15.951308 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=5698d8d0-b76b-461e-978b-d3c856fbcb36,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:32:15.961699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:16.060068 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP 2a028410-b44e-419e-946e-8d5183117164 associated. External IP: 172.27.2.221, port: 9d306c33-58a6-46b4-9ff6-763c1d82d7b6. Nov 24 16:32:16.259912 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:32:16.596378 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:32:16.606841 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:32:16.617038 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:32:16.617651 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:32:16.688992 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:16.715033 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-184bbb54-fc99-4eef-bb3a-2e39197f389d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0498464 Nov 24 16:32:16.715622 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:32:16.717892 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162" -d '{"events": [{"name": "network-changed", "server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:32:16.722323 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:32:16.753318 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:32:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3168990-6049-47d5-9be1-31f8483f42f5 x-openstack-request-id: req-f3168990-6049-47d5-9be1-31f8483f42f5 {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:32:16.753605 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:32:16.753855 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f3168990-6049-47d5-9be1-31f8483f42f5 {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:32:16.754250 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'status': 'completed', 'code': 200} Nov 24 16:32:16.816643 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-b4852272-87a9-443b-83e6-51702a23733e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:16.818245 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-b4852272-87a9-443b-83e6-51702a23733e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1099 time: 0.0408132 Nov 24 16:32:16.912667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-99267bc4-7541-4468-999d-baf3a6eca1e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:16.914051 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-99267bc4-7541-4468-999d-baf3a6eca1e8 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0878031 Nov 24 16:32:16.938396 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-bd196218-9fff-4710-85a4-e2709e63f426 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:16.957828 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '2a028410-b44e-419e-946e-8d5183117164', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:ff:e3:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:32:15Z', 'updated_at': '2021-11-24T16:32:15Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:32:16.979761 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-3ba42e47-82e8-43d3-a0dc-bdcef0ab27b7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 200 len: 1000 time: 0.0580006 Nov 24 16:32:16.988175 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:32:16.997130 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:32:16.997737 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:31:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:32:17.029683 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-d5da09f0-5327-4474-bc23-2ff06d286b5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:17.031162 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-d5da09f0-5327-4474-bc23-2ff06d286b5f service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0435891 Nov 24 16:32:17.080953 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-08974d2b-ec09-4075-8740-f59074f665ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:17.082447 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-08974d2b-ec09-4075-8740-f59074f665ce service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437624 Nov 24 16:32:17.102364 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:32:17.171359 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-ddd21ecb-0d2a-478f-ba77-4ef8292f6ad2 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816920 Nov 24 16:32:17.264829 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-f8bdd5ed-fd38-466a-bf85-baa4ac9be162 req-e8413320-387c-405e-99d7-deb9c2d2b114 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854905 Nov 24 16:32:17.322932 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '2a028410-b44e-419e-946e-8d5183117164', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:ff:e3:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:32:15Z', 'updated_at': '2021-11-24T16:32:15Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:32:17.348925 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d051226c-2f0c-4ecd-ba2d-5ed026514676 None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '2a028410-b44e-419e-946e-8d5183117164', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:ff:e3:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:32:15Z', 'updated_at': '2021-11-24T16:32:15Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:32:17.537458 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c46580f-fee5-482f-8eae-57f6883a98be None None] New status for floating IP 2a028410-b44e-419e-946e-8d5183117164: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:32:19.280682 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2d84d30d-b292-4e88-b23a-a700fd7bccf9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:20.386154 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:21.728676 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:22.460300 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:29.092273 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:32.276374 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-0ffabc06-1146-4484-9a0a-3940f184c942 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0417056 Nov 24 16:32:32.360265 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-f7b17c06-e002-4b65-8bae-907eaaa9971c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:32.361616 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-f7b17c06-e002-4b65-8bae-907eaaa9971c service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1099 time: 0.0392511 Nov 24 16:32:32.465821 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-f3221e87-c9f9-43eb-bf92-32fc72199561 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:32.467322 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-f3221e87-c9f9-43eb-bf92-32fc72199561 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0861075 Nov 24 16:32:32.531527 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-9d57e59b-a32a-4502-ba5f-034e5c89911f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 200 len: 1002 time: 0.0556550 Nov 24 16:32:32.586051 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-7a479285-9157-4368-af58-8480446113d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:32.587514 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-7a479285-9157-4368-af58-8480446113d1 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0478055 Nov 24 16:32:32.633978 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-87abe978-2679-4708-a1ba-fbeaeb43f6d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:32:32.635431 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-87abe978-2679-4708-a1ba-fbeaeb43f6d2 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405414 Nov 24 16:32:32.727322 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-2de102ce-8f70-4e12-a596-aaf4f53ad721 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835390 Nov 24 16:32:32.816867 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a42809df-9452-477e-8b58-ebbe4cd93b4d req-b05c126e-6822-4fff-9c7d-fd56ebc53660 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796602 Nov 24 16:32:43.148387 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:32:46.926247 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e99d6f45-6e93-4c67-968b-f1d53ea83bab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:49.225114 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-dc3f9c4b-1342-475d-bf7b-1eefe7e2f32d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:50.430946 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:51.737508 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:52.442254 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:32:59.077035 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:16.904411 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6af50238-e2c4-48cd-bb74-c1ed0b7ff2b3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:19.236293 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-801f4104-45b5-4344-97e3-bac01d433e18 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:20.148093 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:33:20.395796 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:21.772683 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:22.416724 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:29.080353 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:33.295419 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-302a3853-1d5f-4feb-9bb9-fdf813e1e136 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0844381 Nov 24 16:33:33.380420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-8cade8c6-7412-48e8-b8b2-b29591eaa04e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:33:33.381790 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-8cade8c6-7412-48e8-b8b2-b29591eaa04e service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 1099 time: 0.0432689 Nov 24 16:33:33.484423 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-39babdc2-9c68-4777-81a1-8fbda98311f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:33:33.486391 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-39babdc2-9c68-4777-81a1-8fbda98311f2 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0835912 Nov 24 16:33:33.554146 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-aef94c72-0023-4c8e-b8da-1940025ebd31 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 200 len: 1002 time: 0.0598905 Nov 24 16:33:33.601826 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-a66cf84d-c69d-4e1a-b3b9-edd941aa6a79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:33:33.611553 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-a66cf84d-c69d-4e1a-b3b9-edd941aa6a79 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0423746 Nov 24 16:33:33.648485 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-b4b362e3-6be3-4234-9b4d-04f71d8cff75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:33:33.649006 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-b4b362e3-6be3-4234-9b4d-04f71d8cff75 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392985 Nov 24 16:33:33.661641 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-6815cfe1-3743-4b56-ad7f-f445338e1d85 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:33:33.662553 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-6815cfe1-3743-4b56-ad7f-f445338e1d85 service neutron] 10.222.0.84 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052469 Nov 24 16:33:33.755150 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-96337e1a-8e03-4389-acbf-59b1122754c5 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847635 Nov 24 16:33:33.844357 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0cc41beb-d8c4-4423-9cd5-6159b8574c36 req-58a2b889-687b-4bf1-ad2c-4ffb624a43a2 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811248 Nov 24 16:33:46.909541 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4680fa68-950c-4c85-8cf0-38857a806a26 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:49.250588 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-b85a2cb7-5972-4535-8016-a9f8deee9b7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:50.389557 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:51.738120 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:52.412406 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:33:57.146165 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:33:59.130653 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:10.844383 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a487d8fa-262a-4c67-b3c3-7e0a9e69138e req-d175aea3-9518-4766-b9dd-85b9a621cda9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:10.845817 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a487d8fa-262a-4c67-b3c3-7e0a9e69138e req-d175aea3-9518-4766-b9dd-85b9a621cda9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.1546493 Nov 24 16:34:10.901469 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a487d8fa-262a-4c67-b3c3-7e0a9e69138e req-dfd108d0-b917-4967-8ad5-c7796e392574 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490849 Nov 24 16:34:12.070736 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c16947-1ca3-4c6f-a0fd-49b5b9006fca req-a9bfb4cf-8cb8-46b9-8706-0b85a87a1004 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:12.070736 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89c16947-1ca3-4c6f-a0fd-49b5b9006fca req-a9bfb4cf-8cb8-46b9-8706-0b85a87a1004 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.0970004 Nov 24 16:34:12.116436 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89c16947-1ca3-4c6f-a0fd-49b5b9006fca req-405b0e14-5d8a-4477-ae8c-0d2d72b50dc9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428622 Nov 24 16:34:12.312091 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-95b29576-5fbf-47ca-878d-33af5cc1a4da tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:12.313770 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-95b29576-5fbf-47ca-878d-33af5cc1a4da tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 946 time: 0.0477834 Nov 24 16:34:12.402509 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:34:12.402764 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:12.488747 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] For port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:34:12.489101 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:12.651836 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:12.652323 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:12.652742 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP 2a028410-b44e-419e-946e-8d5183117164 disassociated. External IP: 172.27.2.221, port: 9d306c33-58a6-46b4-9ff6-763c1d82d7b6. Nov 24 16:34:12.652994 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:34:12.851788 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:12.880407 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=9d306c33-58a6-46b4-9ff6-763c1d82d7b6,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:12.891922 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.892288 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.892640 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.892985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.893325 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.893664 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.894000 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.894334 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.894667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.895026 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.895357 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:12.895685 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:13.005604 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:34:13.111308 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:34:13.121815 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:34:13.131482 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:34:13.132173 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:33:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:13.149827 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] No DVR routers for this DVR port 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:34:13.152297 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:13.155616 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a65aa854-bd24-4d5b-a15f-8c11ed35b982 req-b1f2bf37-1d14-4a5a-83cb-59dcc73b0fcf tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "DELETE /v2.0/ports/9d306c33-58a6-46b4-9ff6-763c1d82d7b6 HTTP/1.1" status: 204 len: 173 time: 0.8356225 Nov 24 16:34:13.157010 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'name': 'network-vif-deleted', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:34:13.161098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb125f8b-f125-4388-800d-2d0ef4517aa8" -d '{"events": [{"server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "name": "network-vif-deleted", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:34:13.238891 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a8463a69-fd77-4dfb-bfc1-bc404c119b70 req-8714df21-467d-43af-9b3b-5befe9a420ca tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 210 time: 0.0393806 Nov 24 16:34:13.301093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:34:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f89bd62-2df9-4587-9250-4f40f6f0789b x-openstack-request-id: req-6f89bd62-2df9-4587-9250-4f40f6f0789b {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:34:13.301393 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0c26a2a-f8ef-49f4-bc52-95d349b58898", "name": "network-vif-deleted", "tag": "9d306c33-58a6-46b4-9ff6-763c1d82d7b6", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:34:13.301654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-6f89bd62-2df9-4587-9250-4f40f6f0789b {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:34:13.302063 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0c26a2a-f8ef-49f4-bc52-95d349b58898', 'name': 'network-vif-deleted', 'tag': '9d306c33-58a6-46b4-9ff6-763c1d82d7b6', 'status': 'completed', 'code': 200} Nov 24 16:34:13.390278 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:34:13.588377 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:13.613711 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:34:13.621849 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:34:13.622478 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:33:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:13.727476 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:34:13.925986 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:13.960129 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b89bbb2d-7ffe-44ec-8726-6e9d51a7f986 None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:34:14.169862 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f55e52e-982b-4928-9308-9e5ecacac0c0 None None] New status for floating IP 2a028410-b44e-419e-946e-8d5183117164: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:34:14.357602 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a2ea1bd5-c2fc-453c-be12-ee43c4fcb1a5 req-4115bbcf-db79-439c-8277-553808f5e32a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=b0c26a2a-f8ef-49f4-bc52-95d349b58898 HTTP/1.1" status: 200 len: 210 time: 0.0269835 Nov 24 16:34:15.563705 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-2d63898e-3262-4032-80b6-e9661649bfdc tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1116717563&fields=id&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 267 time: 0.0429916 Nov 24 16:34:15.676029 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-aab0ea96-bcd9-4a97-a4fe-70c7b250aaf0 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:15.677375 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-aab0ea96-bcd9-4a97-a4fe-70c7b250aaf0 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.1065500 Nov 24 16:34:15.692451 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-878d2298-7852-4770-8054-8d597b63342a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/quotas/3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 375 time: 0.0094550 Nov 24 16:34:15.741601 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-e293aabd-b96f-41e0-bccb-4b0dc53a192f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0440590 Nov 24 16:34:15.798445 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-814486e5-3483-42ee-a8bf-f189d9d27d49 service neutron] http://10.222.0.82:9696/v2.0/extensions returned with HTTP 200 {{(pid=103142) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 16:34:15.799545 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-814486e5-3483-42ee-a8bf-f189d9d27d49 service neutron] 10.222.0.82 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0467556 Nov 24 16:34:15.887430 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-301c18d0-593e-48ff-b8c4-b3c890e751e0 service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811100 Nov 24 16:34:15.986752 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-58bc294c-8647-4e10-a6b7-3ead7764962c service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934017 Nov 24 16:34:16.513748 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:34:16.544207 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:34:16.544556 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 9d306c33-58a6-46b4-9ff6-763c1d82d7b6 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:34:16.554133 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-ad24f394-3058-4c1c-b0a5-29080ad65511 req-7e0a9936-53ef-4ce9-95dc-16bf844f7434 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 210 time: 0.0261774 Nov 24 16:34:16.903453 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-7305d7ad-2c31-4217-96a6-2e2cd38c5234 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:17.646476 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6c83d1f2-9906-484a-93d8-b24b725b4943 req-149fac2c-5796-474f-98f6-7b623d55d41e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 210 time: 0.0257804 Nov 24 16:34:18.420020 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-ed842946-6276-47f2-ba84-2c6e836a1ab0 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:18.421400 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-ed842946-6276-47f2-ba84-2c6e836a1ab0 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.1034474 Nov 24 16:34:18.485179 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-733cf781-c00c-4ad8-9020-3fef56aac137 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 380 time: 0.0543103 Nov 24 16:34:18.495004 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'port': {'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'admin_state_up': True, 'tenant_id': '3b37384f944943228da7761c28d2688c', 'security_groups': ['57111423-b7f2-4a51-99d9-39fc5eedc05d']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:34:18.663654 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Made reservation on behalf of 3b37384f944943228da7761c28d2688c for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:34:18.667290 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:18.801511 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.20.0.6 (d5daf004-999b-4292-8917-46525a8f363e/ed51ff75-126f-45c3-ab4f-52644e5c0709/598a586c-3aae-4fa0-940c-be701011d838) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:34:18.895764 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-a693cc62-5a0c-4600-8132-c79edc791ee5 req-b4bcc96e-19e7-4cc8-a771-0bb065b99f52 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 210 time: 0.0286682 Nov 24 16:34:19.204303 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.256356 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-65ae6593-89f8-4f72-92e9-539f11982fd1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.307934 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.351795 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:34:19.354768 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:34:19.358382 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:34:19.382807 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:19.415821 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:19.416488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.501109 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4b3ac6d5-68c5-4806-940b-4d9cdc6a0c16 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0095994 Nov 24 16:34:19.513342 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Request body: {'port': {'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:34:19.567244 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.597481 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-cf6f3356-f746-40a2-9926-3228ba7f56bf None None] Provisioning complete for port 598a586c-3aae-4fa0-940c-be701011d838 triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:34:19.598385 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-cf6f3356-f746-40a2-9926-3228ba7f56bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.635555 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-cf6f3356-f746-40a2-9926-3228ba7f56bf None None] Port 598a586c-3aae-4fa0-940c-be701011d838 cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:34:19.822449 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 598a586c-3aae-4fa0-940c-be701011d838 {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:34:19.829660 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.841524 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Transition to ACTIVE for port object 598a586c-3aae-4fa0-940c-be701011d838 will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:34:19.897254 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:19.946491 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Pushing event updated for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:20.057757 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fc649c-8ac2-468c-9abe-426a42feab11 req-87729cce-20d8-4f7a-91e2-5c5c512510f9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.059355 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58fc649c-8ac2-468c-9abe-426a42feab11 req-87729cce-20d8-4f7a-91e2-5c5c512510f9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0906739 Nov 24 16:34:20.065119 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Attempting to bind port 598a586c-3aae-4fa0-940c-be701011d838 on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:34:20.065732 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Attempting to bind port 598a586c-3aae-4fa0-940c-be701011d838 by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:34:20.066391 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Attempting to bind port 598a586c-3aae-4fa0-940c-be701011d838 on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:34:20.080466 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Port 598a586c-3aae-4fa0-940c-be701011d838 on network d5daf004-999b-4292-8917-46525a8f363e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:34:20.080794 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Attempting to bind port 598a586c-3aae-4fa0-940c-be701011d838 on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:34:20.094941 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 33, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:34:20.095296 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:34:20.095689 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Bound using segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:34:20.096122 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Bound port: 598a586c-3aae-4fa0-940c-be701011d838, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:34:20.096506 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:20.149551 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58fc649c-8ac2-468c-9abe-426a42feab11 req-835b5195-0d23-4353-b6bb-b8e588124533 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782933 Nov 24 16:34:20.180905 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:34:20.183879 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=598a586c-3aae-4fa0-940c-be701011d838,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:34:20.257971 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:20.294680 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.295277 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:20.296659 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] 10.222.0.84 "PUT /v2.0/ports/598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 1093 time: 0.7877102 Nov 24 16:34:20.297127 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:34:20.299420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b874b15e-72dd-475f-9db2-673b2297dfc9" -d '{"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:34:20.326492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ba0c94c-a6e2-404f-b06f-a63645564050 service neutron] Pushing event updated for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:20.348244 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:34:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e25757fb-fff5-4f82-9f16-a69113b5c096 x-openstack-request-id: req-e25757fb-fff5-4f82-9f16-a69113b5c096 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:34:20.355328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:34:20.355328 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-e25757fb-fff5-4f82-9f16-a69113b5c096 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:34:20.355328 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838', 'status': 'completed', 'code': 200} Nov 24 16:34:20.406298 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:20.418519 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-e3be81cf-5ee7-4cc1-a3ae-65b22c21ddac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.420357 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-e3be81cf-5ee7-4cc1-a3ae-65b22c21ddac service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1096 time: 0.0439367 Nov 24 16:34:20.523948 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-ef27f64d-0881-4189-bda9-f7dbb5153137 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.525480 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-ef27f64d-0881-4189-bda9-f7dbb5153137 service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=3b37384f944943228da7761c28d2688c&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0968683 Nov 24 16:34:20.622473 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-5baf4ea2-57d3-4271-a00a-2d8500f8ef03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.623975 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-b874b15e-72dd-475f-9db2-673b2297dfc9 req-5baf4ea2-57d3-4271-a00a-2d8500f8ef03 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0906985 Nov 24 16:34:20.698488 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-9785bd8f-825f-4ea9-94dc-957c2c039f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.699868 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-9785bd8f-825f-4ea9-94dc-957c2c039f25 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1096 time: 0.0398047 Nov 24 16:34:20.740526 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-4017acc5-6f60-4db8-8765-43a71814446e service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 217 time: 0.0328097 Nov 24 16:34:20.790268 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-149d91b3-bc71-4dc2-97b7-c9ccd7184a56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.791975 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-149d91b3-bc71-4dc2-97b7-c9ccd7184a56 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0445631 Nov 24 16:34:20.837056 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-cc99c72b-64b2-408c-a200-628daa2b58f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:20.838542 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-cc99c72b-64b2-408c-a200-628daa2b58f3 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391524 Nov 24 16:34:20.929849 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-7aea9b2a-b26a-4297-94cd-83c78f7a91d1 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833738 Nov 24 16:34:21.021719 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-bae30495-3e52-4ed6-badb-a4776e11fc88 req-290ba091-000c-44be-8fb4-f0f1b7890edb service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843129 Nov 24 16:34:21.264699 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cec867-80f5-44b3-b258-e141f87e9e18 req-129cdc35-cabc-47cc-8292-2459a973d382 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:21.266693 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e1cec867-80f5-44b3-b258-e141f87e9e18 req-129cdc35-cabc-47cc-8292-2459a973d382 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0485432 Nov 24 16:34:21.314725 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e1cec867-80f5-44b3-b258-e141f87e9e18 req-317a4ae7-dc80-4e57-984f-fe107fb00065 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418885 Nov 24 16:34:21.748880 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:22.457746 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f35a7f-8066-47a2-bf08-deb504d70fcc req-10f76a4b-189a-42cc-9465-b0b847845a8a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:22.457746 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-11f35a7f-8066-47a2-bf08-deb504d70fcc req-10f76a4b-189a-42cc-9465-b0b847845a8a tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0489430 Nov 24 16:34:22.481917 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-11f35a7f-8066-47a2-bf08-deb504d70fcc req-fe8248ac-423f-486f-801c-18984ed5799d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416586 Nov 24 16:34:22.486048 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:23.598305 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8189e072-d227-4b56-a7fd-5c5cf9a9bda6 req-bb81b89a-a207-4f4f-a328-87152b220c4d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:23.599801 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8189e072-d227-4b56-a7fd-5c5cf9a9bda6 req-bb81b89a-a207-4f4f-a328-87152b220c4d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0524857 Nov 24 16:34:23.648764 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8189e072-d227-4b56-a7fd-5c5cf9a9bda6 req-20fe74ed-b2bb-4a14-abe2-08c4799bb7a5 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431585 Nov 24 16:34:24.762463 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f403d1-776f-462b-920b-1fdb6e3f67f9 req-d7cd600c-084d-44da-88d4-f97801dd6851 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:24.763978 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89f403d1-776f-462b-920b-1fdb6e3f67f9 req-d7cd600c-084d-44da-88d4-f97801dd6851 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0476606 Nov 24 16:34:24.811666 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-89f403d1-776f-462b-920b-1fdb6e3f67f9 req-fa347428-180b-48d6-b815-18aecb1fe7cc tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417962 Nov 24 16:34:25.923880 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c9d63f-34ab-4087-9ac2-cc9cf57ab2c5 req-163ebbb6-ad19-481a-b333-91647a5e3939 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:25.925323 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-69c9d63f-34ab-4087-9ac2-cc9cf57ab2c5 req-163ebbb6-ad19-481a-b333-91647a5e3939 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0475469 Nov 24 16:34:25.973867 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-69c9d63f-34ab-4087-9ac2-cc9cf57ab2c5 req-a5f79e1a-73d8-45f1-bb25-42588d0c6208 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419540 Nov 24 16:34:27.087485 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9baae753-c1a7-437b-804e-643e0e20f6a0 req-c4778218-d308-4c19-99a1-60445a415288 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:27.088939 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9baae753-c1a7-437b-804e-643e0e20f6a0 req-c4778218-d308-4c19-99a1-60445a415288 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0507779 Nov 24 16:34:27.137124 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-9baae753-c1a7-437b-804e-643e0e20f6a0 req-680e0e98-97cc-4e6f-a26c-190b47a19a39 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424368 Nov 24 16:34:28.247895 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f0d442-3b6b-408e-96b5-947e6e74e78d req-9028527a-dd9c-46d1-a56a-dd8a73cc6b87 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:28.249344 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5f0d442-3b6b-408e-96b5-947e6e74e78d req-9028527a-dd9c-46d1-a56a-dd8a73cc6b87 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 943 time: 0.0478907 Nov 24 16:34:28.307696 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d5f0d442-3b6b-408e-96b5-947e6e74e78d req-f7d7b3b6-9e0b-4f12-aaad-6d020ddf715e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515022 Nov 24 16:34:28.544209 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 598a586c-3aae-4fa0-940c-be701011d838 details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:34:28.642408 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=598a586c-3aae-4fa0-940c-be701011d838,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:34:28.653204 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': '598a586c-3aae-4fa0-940c-be701011d838', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:34:28.689980 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:28.705123 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 598a586c-3aae-4fa0-940c-be701011d838 {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:34:28.723782 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=598a586c-3aae-4fa0-940c-be701011d838,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:34:28.794341 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:28.839670 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:28.846381 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.846750 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.847115 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.848042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.848372 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.848705 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.849029 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.849353 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.849676 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.849996 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.850313 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:28.850630 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:34:29.032934 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['598a586c-3aae-4fa0-940c-be701011d838'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:34:29.099967 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:29.420399 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51e0da3-7407-4116-8e09-21d584167a0a req-2151d611-86f5-4355-8eeb-3d378a190d13 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:29.421786 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b51e0da3-7407-4116-8e09-21d584167a0a req-2151d611-86f5-4355-8eeb-3d378a190d13 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 944 time: 0.0478766 Nov 24 16:34:29.469302 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b51e0da3-7407-4116-8e09-21d584167a0a req-e620da9a-92bd-4767-8b40-e6b8c9ddb892 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409930 Nov 24 16:34:30.551223 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 598a586c-3aae-4fa0-940c-be701011d838 up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:34:30.584885 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5f5b51-f147-4644-8943-c0d406e88810 req-7c28a3f6-6644-4e76-a718-c9c2fe64d044 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:30.586425 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fa5f5b51-f147-4644-8943-c0d406e88810 req-7c28a3f6-6644-4e76-a718-c9c2fe64d044 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 944 time: 0.0515847 Nov 24 16:34:30.635542 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-fa5f5b51-f147-4644-8943-c0d406e88810 req-d8203ae4-3caf-4a49-b3ee-f732e08d4cc4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429666 Nov 24 16:34:30.674403 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port 598a586c-3aae-4fa0-940c-be701011d838 completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:34:30.678448 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port 598a586c-3aae-4fa0-940c-be701011d838 triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:34:30.678816 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:30.761952 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:30.783136 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '598a586c-3aae-4fa0-940c-be701011d838'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:34:30.785872 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0829906-1cb9-44b1-97ba-8a2e830b73af" -d '{"events": [{"server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "name": "network-vif-plugged", "status": "completed", "tag": "598a586c-3aae-4fa0-940c-be701011d838"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:34:30.801381 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=598a586c-3aae-4fa0-940c-be701011d838,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:34:30.874680 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:30.879656 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:34:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dcc614f6-9d42-4444-b6f4-3c843c26a8f6 x-openstack-request-id: req-dcc614f6-9d42-4444-b6f4-3c843c26a8f6 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:34:30.884143 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "name": "network-vif-plugged", "status": "completed", "tag": "598a586c-3aae-4fa0-940c-be701011d838", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:34:30.884143 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-dcc614f6-9d42-4444-b6f4-3c843c26a8f6 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:34:30.884143 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '598a586c-3aae-4fa0-940c-be701011d838', 'code': 200} Nov 24 16:34:30.926252 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:31.232091 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd7ab74-8bec-406f-8bd9-5e682a55b6c0 req-d2f848aa-6d8e-4f2c-ad70-eb1a19a3ed54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:31.233534 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bd7ab74-8bec-406f-8bd9-5e682a55b6c0 req-d2f848aa-6d8e-4f2c-ad70-eb1a19a3ed54 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0399020 Nov 24 16:34:31.278681 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-0bd7ab74-8bec-406f-8bd9-5e682a55b6c0 req-b54c46a7-7f56-4009-a21e-d62cca1ad041 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379097 Nov 24 16:34:31.761120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-504d799e-6373-4cbe-b898-34b7e73e8faa req-65a4139b-8e91-493e-9426-662be554682d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:31.762580 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-504d799e-6373-4cbe-b898-34b7e73e8faa req-65a4139b-8e91-493e-9426-662be554682d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0596316 Nov 24 16:34:31.811496 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-504d799e-6373-4cbe-b898-34b7e73e8faa req-d4d7aff5-a450-42bd-b6dd-6462b60a88ba tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428164 Nov 24 16:34:32.927402 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5848f9c5-1bae-43b0-87b4-1916071a2fba req-db2ab29c-8bb1-494b-8a5f-503e2846dd26 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:32.928855 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5848f9c5-1bae-43b0-87b4-1916071a2fba req-db2ab29c-8bb1-494b-8a5f-503e2846dd26 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0511339 Nov 24 16:34:32.976446 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-5848f9c5-1bae-43b0-87b4-1916071a2fba req-cc76b001-f5c8-4355-8c3a-baf434e54f9d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418761 Nov 24 16:34:33.087530 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d499c03-96ce-487a-9b9a-6561931ac438 req-cc8210ce-a136-4ae3-a755-915e6ffb25d8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.089071 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2d499c03-96ce-487a-9b9a-6561931ac438 req-cc8210ce-a136-4ae3-a755-915e6ffb25d8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0485544 Nov 24 16:34:33.137293 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2d499c03-96ce-487a-9b9a-6561931ac438 req-d2111d10-ec68-459c-880a-09b31429f293 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425062 Nov 24 16:34:33.159232 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56590) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:34:33.197114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9e1135a-daca-402e-831d-d41d8ebb95e8 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.198567 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-e9e1135a-daca-402e-831d-d41d8ebb95e8 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1093 time: 0.0383930 Nov 24 16:34:33.201178 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56592) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:34:33.205441 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:34:33.297911 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:33.338592 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-25b9ed64-7144-4b30-8c12-573bb6603063 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0695391 Nov 24 16:34:33.436387 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-c1efdfc5-3afa-44a0-9fb1-624f97a3f9f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.438027 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-c1efdfc5-3afa-44a0-9fb1-624f97a3f9f3 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0563471 Nov 24 16:34:33.440194 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:33.611486 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-790cbf41-5b5a-476d-974c-05ed6f32ed3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.613488 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-790cbf41-5b5a-476d-974c-05ed6f32ed3d service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.1374743 Nov 24 16:34:33.614500 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.27.2.251 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/8c73fa2a-4097-4b0a-88c5-f3c68ee8362e) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:34:33.660358 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-b65c26e0-ad42-4173-a566-e7d9eb2d78a0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 217 time: 0.0367169 Nov 24 16:34:33.757564 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-344ba7e2-5d65-424e-bf92-3476da29fe76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.759069 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-344ba7e2-5d65-424e-bf92-3476da29fe76 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0879805 Nov 24 16:34:33.809243 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:33.829003 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-2025ba84-dba8-4450-8a49-ea7fefc95575 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:33.830504 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-2025ba84-dba8-4450-8a49-ea7fefc95575 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0643284 Nov 24 16:34:33.931560 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-6b3e255c-a569-4e67-aeb7-2c4401bf55c5 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915012 Nov 24 16:34:33.955684 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.028212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:34:34.035982 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:34:34.044584 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:34:34.071557 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=8c73fa2a-4097-4b0a-88c5-f3c68ee8362e,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:34.106331 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-dfb6a0df-6111-4378-a37b-950b0facb710 req-a971fa0f-a16a-49b6-9b8c-1fd1ce7541ad service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1672857 Nov 24 16:34:34.145406 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:34:34.419800 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.521694 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.666208 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.714231 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.778667 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=8c73fa2a-4097-4b0a-88c5-f3c68ee8362e,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:34:34.790058 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:34.889463 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.db.l3_db [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP e2ecba29-6613-4b2d-b7f4-b06518df25bb associated. External IP: 172.27.2.251, port: 598a586c-3aae-4fa0-940c-be701011d838. Nov 24 16:34:35.092374 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103142) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:34:35.201196 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103142) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:34:35.212164 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:34:35.224783 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:34:35.225772 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:34:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:35.270836 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:35.298184 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-1248fbaf-749a-4823-9fab-40c3ee17a8f8 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0959618 Nov 24 16:34:35.298785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:34:35.301806 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44" -d '{"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:34:35.334027 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:34:35.337832 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:34:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fbc0eec-a62a-4181-80bd-930b318eb6ab x-openstack-request-id: req-3fbc0eec-a62a-4181-80bd-930b318eb6ab {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:34:35.338126 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:34:35.338383 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-3fbc0eec-a62a-4181-80bd-930b318eb6ab {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:34:35.338788 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838', 'status': 'completed', 'code': 200} Nov 24 16:34:35.400959 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-160c8416-0f0b-4a32-958c-ce39fe6a81c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:35.402363 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-160c8416-0f0b-4a32-958c-ce39fe6a81c1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0398574 Nov 24 16:34:35.502296 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-248b0df7-3c08-4f44-bd59-623f0eae2f7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:35.503985 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-248b0df7-3c08-4f44-bd59-623f0eae2f7c service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0915811 Nov 24 16:34:35.562760 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:34Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:35.573454 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-53cae1d8-d618-4952-84a5-c02b01102bd0 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 999 time: 0.0618145 Nov 24 16:34:35.588913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:34:35.598019 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:34:35.598628 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:34:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:35.627416 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-62b50689-d943-4b70-b696-c27ef105ce7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:35.628947 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-62b50689-d943-4b70-b696-c27ef105ce7a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0488150 Nov 24 16:34:35.676332 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-65edaa42-5eda-4e79-ae79-bbe907243047 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:34:35.677778 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-65edaa42-5eda-4e79-ae79-bbe907243047 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402377 Nov 24 16:34:35.703190 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:34:35.772368 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-2f8703bb-dfe2-43a0-ae97-7b14c5582264 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844426 Nov 24 16:34:35.870126 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ec3f9174-66e8-4da1-92a1-dac7c8ee3d44 req-20eada18-262f-46ba-940e-1be60a17c27b service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873661 Nov 24 16:34:35.936135 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:34Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:34:35.962146 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc76067f-5d5c-4fcc-8ffe-36691250fe9e None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:34Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:34:36.143378 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d744bb1b-7404-44fe-895a-f070df95f225 None None] New status for floating IP e2ecba29-6613-4b2d-b7f4-b06518df25bb: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:34:46.947126 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2527d933-a22a-4054-9b8a-87f012ae90a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:49.255291 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c8add591-ad58-4b7e-938a-7b372c46bc9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:50.410042 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:51.752448 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:52.439530 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:34:59.140705 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:11.144046 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:35:16.895821 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a65d0504-5d80-4ec1-8047-64bd44b26e01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:19.261263 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2afaa67c-4b00-415b-bf70-17e9256eae4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:20.381728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:21.763347 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:22.431870 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:29.129984 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:35.258592 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-c541c4b7-f236-4ffc-93f9-659b3033e815 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0395000 Nov 24 16:35:35.343338 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-2a7b2463-8b64-40a9-a685-0af5ac7ac4bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:35:35.344826 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-2a7b2463-8b64-40a9-a685-0af5ac7ac4bb service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0434098 Nov 24 16:35:35.448821 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-de99cf2e-73c1-4ee3-b51c-c0a1f04e57ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:35:35.450183 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-de99cf2e-73c1-4ee3-b51c-c0a1f04e57ff service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0843580 Nov 24 16:35:35.517092 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-ff6dccb5-c8f2-4cad-9fce-05764d45bd27 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 1001 time: 0.0594647 Nov 24 16:35:35.821822 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-53ce0555-19d6-461a-8aac-e71c285a06b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:35:35.823292 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-53ce0555-19d6-461a-8aac-e71c285a06b6 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.2991848 Nov 24 16:35:35.867471 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-b861201c-a5e9-4eb8-ab0e-ba5ce84080eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:35:35.868891 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-b861201c-a5e9-4eb8-ab0e-ba5ce84080eb service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382810 Nov 24 16:35:35.958642 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-3ec6caa5-99de-46be-a781-394dd69ecb76 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820208 Nov 24 16:35:36.045391 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-a5f86df8-88f6-4ccf-8496-698b4722a449 req-280910fa-dae4-46ed-aff9-4427787d3ae2 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794606 Nov 24 16:35:46.907101 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-720ac9c9-367f-481f-9dac-08b7bcfaf13d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:48.143257 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:35:49.255577 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-d6377258-a26a-43f5-b0a5-6970961cd2e5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:50.385437 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:51.763722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:52.466688 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:35:59.129383 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:14.508348 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-db6ef95f-d509-4089-8e4d-159baa9a74f9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1116717563&fields=id&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 267 time: 0.0432675 Nov 24 16:36:14.615168 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-9fcd078d-cdee-4444-a278-85f980d2bfad tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:14.616655 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-9fcd078d-cdee-4444-a278-85f980d2bfad tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.1018157 Nov 24 16:36:14.631053 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-d85dc4d0-b48d-44b4-be81-653015c02a7c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/quotas/3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 375 time: 0.0085611 Nov 24 16:36:14.683968 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-69289864-37b5-4e4e-8a49-ea6c43f36382 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0478635 Nov 24 16:36:14.780424 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-1858d4d6-2d87-4aa3-8489-a24003d99148 service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852642 Nov 24 16:36:14.868188 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-106d04ba-e775-4219-ad90-fc50b51fc3b2 service neutron] 10.222.0.82 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818260 Nov 24 16:36:15.365529 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-b5caf342-8df0-4f19-87e3-4dac536a47e3 req-a144ded8-52ba-43b8-a0cd-fae1b778db1e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 210 time: 0.0264661 Nov 24 16:36:16.462871 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-50cf6770-2fda-4869-bb4d-1da6342b7196 req-c1955a45-6d02-4e96-9f35-7db6e56ef635 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 210 time: 0.0319252 Nov 24 16:36:16.940491 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-ad3b6d37-3afa-4d99-a762-377c8c60e14f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.043353 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-de03cd0a-ee91-41e2-ba95-24119ac3d3b4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:17.045005 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-de03cd0a-ee91-41e2-ba95-24119ac3d3b4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 812 time: 0.1056178 Nov 24 16:36:17.109883 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-42c08543-3be9-4135-88a5-25e01bc6cc46 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3b37384f944943228da7761c28d2688c HTTP/1.1" status: 200 len: 380 time: 0.0540395 Nov 24 16:36:17.119792 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'port': {'device_id': '176d8748-e545-4387-98bb-7d8552a773cb', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'admin_state_up': True, 'tenant_id': '3b37384f944943228da7761c28d2688c', 'security_groups': ['57111423-b7f2-4a51-99d9-39fc5eedc05d']}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:36:17.289761 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Made reservation on behalf of 3b37384f944943228da7761c28d2688c for: {'port': 1} {{(pid=103142) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 16:36:17.293425 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.436694 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_common [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.20.0.7 (d5daf004-999b-4292-8917-46525a8f363e/ed51ff75-126f-45c3-ab4f-52644e5c0709/a14b0295-28ee-4633-b01e-44157c5f0b3b) {{(pid=103142) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:36:17.556562 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-93990f7d-1861-44ab-806e-a823dc8dd5a8 req-77efab6e-a8bf-4981-8f80-369d57596ed9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 210 time: 0.0262821 Nov 24 16:36:17.576415 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.682687 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_create {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.732212 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network d5daf004-999b-4292-8917-46525a8f363e is already hosted by enough agents. {{(pid=103142) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:36:17.735526 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.scheduler.base_scheduler [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103142) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:36:17.739566 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103142) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:36:17.765347 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=1']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:17.779906 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.780253 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.780595 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.780937 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.781257 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.781579 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.781906 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.782229 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.782555 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.782880 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.783219 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.783539 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:17.806293 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:17.806985 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.903652 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-13d98725-f111-4751-a397-d4ec0cabf1f7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7879498 Nov 24 16:36:17.917314 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.v2.base [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Request body: {'port': {'device_id': '176d8748-e545-4387-98bb-7d8552a773cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81900'}} {{(pid=103142) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:36:17.971090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:17.978859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-e282b037-1a4d-4097-9463-5b1858788afc None None] Provisioning complete for port a14b0295-28ee-4633-b01e-44157c5f0b3b triggered by entity DHCP. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:36:17.979417 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e282b037-1a4d-4097-9463-5b1858788afc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.013747 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-e282b037-1a4d-4097-9463-5b1858788afc None None] Port a14b0295-28ee-4633-b01e-44157c5f0b3b cannot update to ACTIVE because it is not bound. {{(pid=103143) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 16:36:18.236458 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a14b0295-28ee-4633-b01e-44157c5f0b3b {{(pid=103142) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:36:18.243660 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.254981 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.provisioning_blocks [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Transition to ACTIVE for port object a14b0295-28ee-4633-b01e-44157c5f0b3b will not be triggered until provisioned by entity L2. {{(pid=103142) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 16:36:18.339642 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.388331 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Pushing event updated for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=2']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:18.465532 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Attempting to bind port a14b0295-28ee-4633-b01e-44157c5f0b3b on host hv-cinder-81900 for vnic_type normal with profile {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 16:36:18.465867 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Attempting to bind port a14b0295-28ee-4633-b01e-44157c5f0b3b by drivers openvswitch,hyperv on host hv-cinder-81900 at level 0 using segments [{'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 16:36:18.466191 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Attempting to bind port a14b0295-28ee-4633-b01e-44157c5f0b3b on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:36:18.470726 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Port a14b0295-28ee-4633-b01e-44157c5f0b3b on network d5daf004-999b-4292-8917-46525a8f363e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81900 {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 16:36:18.471090 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Attempting to bind port a14b0295-28ee-4633-b01e-44157c5f0b3b on network d5daf004-999b-4292-8917-46525a8f363e {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 16:36:18.475973 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Checking agent: {'id': 'e27491e5-6068-4550-a377-8729ea756241', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81900', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'started_at': datetime.datetime(2021, 11, 24, 16, 20, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 16, 35, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 16:36:18.476349 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Checking segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103142) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 16:36:18.476733 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Bound using segment: {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'} {{(pid=103142) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 16:36:18.477158 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.managers [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Bound port: a14b0295-28ee-4633-b01e-44157c5f0b3b, host: hv-cinder-81900, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01daf12f-03fc-4264-b82d-d482465642e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e'}}] {{(pid=103142) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 16:36:18.477513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.541540 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, cleared binding levels {{(pid=103142) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 16:36:18.544629 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 16:36:18.621139 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-26164607'] for port, after_update {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.675008 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:18.675647 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:18.677074 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] 10.222.0.84 "PUT /v2.0/ports/a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 200 len: 1093 time: 0.7644675 Nov 24 16:36:18.692303 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:36:18.693137 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d01c3738-5f3c-411e-b525-649fa2f3bcce" -d '{"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:36:18.724057 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4c2e8d-7f4c-4627-8325-5e2006006a57 service neutron] Pushing event updated for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=3']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:18.746384 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6064377a-c3f6-401b-936d-b228a85a914e req-2c20b25e-e495-4056-accc-07a8a82ebb01 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:18.747400 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6064377a-c3f6-401b-936d-b228a85a914e req-2c20b25e-e495-4056-accc-07a8a82ebb01 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.1169832 Nov 24 16:36:18.748992 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:36:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f622a78c-1f18-4fde-8295-768f42102628 x-openstack-request-id: req-f622a78c-1f18-4fde-8295-768f42102628 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:36:18.749281 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:36:18.749658 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-f622a78c-1f18-4fde-8295-768f42102628 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:36:18.749915 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'status': 'completed', 'code': 200} Nov 24 16:36:18.830548 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6064377a-c3f6-401b-936d-b228a85a914e req-66b1609c-7669-49e4-889f-cb647ec9580c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769982 Nov 24 16:36:18.837459 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-6b5142a2-4da3-4e9b-9ef7-54e163ed6ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:18.839050 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-6b5142a2-4da3-4e9b-9ef7-54e163ed6ed0 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1096 time: 0.0676050 Nov 24 16:36:18.937093 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-351e1125-516e-4f86-9549-bce888ba7a5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:18.938450 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-351e1125-516e-4f86-9549-bce888ba7a5c service neutron] 10.222.0.84 "GET /v2.0/networks?tenant_id=3b37384f944943228da7761c28d2688c&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0915008 Nov 24 16:36:19.038807 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-f27363b6-8966-430d-b551-3bd43a1488c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:19.040214 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d01c3738-5f3c-411e-b525-649fa2f3bcce req-f27363b6-8966-430d-b551-3bd43a1488c8 service neutron] 10.222.0.84 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0938888 Nov 24 16:36:19.122822 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-80a09e04-ecd4-4617-a4fe-d20295a0fbad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:19.124315 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-80a09e04-ecd4-4617-a4fe-d20295a0fbad service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1096 time: 0.0400114 Nov 24 16:36:19.169893 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-753e92fc-c0fc-4132-a183-897b6a2b8475 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 200 len: 217 time: 0.0359712 Nov 24 16:36:19.219513 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-2b6c8b1c-4ba7-4fe3-867a-a44070392336 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:19.220959 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-2b6c8b1c-4ba7-4fe3-867a-a44070392336 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0434024 Nov 24 16:36:19.249165 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-0f74957d-6d0c-4a7d-a715-233afdde0734 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:19.267005 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-6e7e07d5-34eb-40bc-b5d8-54167540b66f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:19.268547 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-6e7e07d5-34eb-40bc-b5d8-54167540b66f service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394013 Nov 24 16:36:19.363110 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-9636d5d2-4a6f-494a-9bb7-acd30dc6ae92 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858212 Nov 24 16:36:19.457522 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7e032ff1-bb74-407e-b24c-9e69c3d4106f req-fafe931b-ce8a-40a9-804a-b03213561fce service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862806 Nov 24 16:36:19.944500 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a58f79b-d47f-4cb4-89d0-1ba8c956def7 req-faac3948-aace-4d50-97d4-678487ceea55 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:19.946462 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7a58f79b-d47f-4cb4-89d0-1ba8c956def7 req-faac3948-aace-4d50-97d4-678487ceea55 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0482106 Nov 24 16:36:19.997037 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-7a58f79b-d47f-4cb4-89d0-1ba8c956def7 req-085d0f30-cb8e-40f5-82be-506a2e22d405 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446751 Nov 24 16:36:20.402032 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:21.114337 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deed4011-5c15-46e0-a33a-dbe01c35b4b8 req-c008a260-327d-45d7-ad0a-58f1559af9f4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:21.115848 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-deed4011-5c15-46e0-a33a-dbe01c35b4b8 req-c008a260-327d-45d7-ad0a-58f1559af9f4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0528476 Nov 24 16:36:21.163223 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-deed4011-5c15-46e0-a33a-dbe01c35b4b8 req-fc156e47-dc31-45a2-9bcf-1389a44d4acb tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414531 Nov 24 16:36:21.757074 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:22.276144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94340553-38a5-46ee-a1be-8a620fde09da req-e3e03855-2a96-4fdd-9b1d-6009906e15bb tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:22.277616 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-94340553-38a5-46ee-a1be-8a620fde09da req-e3e03855-2a96-4fdd-9b1d-6009906e15bb tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0485473 Nov 24 16:36:22.325495 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-94340553-38a5-46ee-a1be-8a620fde09da req-ea7e1cf5-d572-44f5-982f-b11bc8a90e6e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420198 Nov 24 16:36:22.448914 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:23.441760 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fee74b1-5a46-44f0-932d-4b5429381f07 req-c57dfd1d-625b-453b-b0bf-e6c4a14d1128 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:23.443245 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7fee74b1-5a46-44f0-932d-4b5429381f07 req-c57dfd1d-625b-453b-b0bf-e6c4a14d1128 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0483341 Nov 24 16:36:23.490462 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7fee74b1-5a46-44f0-932d-4b5429381f07 req-477a5221-966c-4129-b554-44b371adf9ba tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407913 Nov 24 16:36:24.602053 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b7f2e1-4d77-45a5-9914-faf9656ee4aa req-e8617714-3721-4b4e-be47-4b3ca2be721c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:24.603511 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-64b7f2e1-4d77-45a5-9914-faf9656ee4aa req-e8617714-3721-4b4e-be47-4b3ca2be721c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0471179 Nov 24 16:36:24.650044 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-64b7f2e1-4d77-45a5-9914-faf9656ee4aa req-6fffe490-b1e8-4b92-b181-cff7e455c9f4 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407674 Nov 24 16:36:25.142397 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:36:25.762447 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abf0321-fcb1-45cc-acd3-ec3b0995243b req-7df61deb-d243-4ec9-b7e5-a712dfeff7fa tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:25.763912 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1abf0321-fcb1-45cc-acd3-ec3b0995243b req-7df61deb-d243-4ec9-b7e5-a712dfeff7fa tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0470867 Nov 24 16:36:25.814808 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1abf0321-fcb1-45cc-acd3-ec3b0995243b req-3b6656ab-b06c-4b19-9e8c-12cb091278bc tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451081 Nov 24 16:36:26.930284 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9d8b6f-4388-43d7-9c62-99d6e853ae9e req-a7831fbe-9801-4e9e-8974-fbae74030af7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:26.931797 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0e9d8b6f-4388-43d7-9c62-99d6e853ae9e req-a7831fbe-9801-4e9e-8974-fbae74030af7 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 943 time: 0.0513575 Nov 24 16:36:26.980562 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0e9d8b6f-4388-43d7-9c62-99d6e853ae9e req-d98586fa-ec9e-4e8e-9a96-b7b894b0b56c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426676 Nov 24 16:36:27.147720 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a14b0295-28ee-4633-b01e-44157c5f0b3b details requested by agent hyperv_hv-cinder-81900 with host hv-cinder-81900 {{(pid=103143) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 16:36:27.242441 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:36:27.253335 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Returning: {'device': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'port_id': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'mac_address': 'fa:16:3e:f5:21:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103143) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 16:36:27.289100 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:27.301389 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a14b0295-28ee-4633-b01e-44157c5f0b3b {{(pid=103143) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 16:36:27.321408 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:36:27.379707 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:27.428654 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=4']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:27.436644 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.437004 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.437355 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.437699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.438037 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.438376 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.438712 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.439077 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.439412 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.439744 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.440077 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.440406 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:27.620379 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] get_ports_and_sgs() called for port_ids ['a14b0295-28ee-4633-b01e-44157c5f0b3b'] {{(pid=103143) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 16:36:28.098900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ab0d0c-0524-4352-b2d5-0c56943c7da6 req-8a6eb794-9942-47fb-a3bc-283898945e97 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:28.100434 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58ab0d0c-0524-4352-b2d5-0c56943c7da6 req-8a6eb794-9942-47fb-a3bc-283898945e97 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 944 time: 0.0548251 Nov 24 16:36:28.149385 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-58ab0d0c-0524-4352-b2d5-0c56943c7da6 req-2ec4bd2e-467f-45aa-91f6-4b294980fb26 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421760 Nov 24 16:36:29.105838 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:29.154888 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a14b0295-28ee-4633-b01e-44157c5f0b3b up at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 16:36:29.260843 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f4942e-fd44-40d3-9916-d4d5e9d43831 req-ea8a5257-cd0d-4b10-b0c4-28dbdac0012f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:29.262309 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f3f4942e-fd44-40d3-9916-d4d5e9d43831 req-ea8a5257-cd0d-4b10-b0c4-28dbdac0012f tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 944 time: 0.0477993 Nov 24 16:36:29.271594 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning for port a14b0295-28ee-4633-b01e-44157c5f0b3b completed by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 16:36:29.275664 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.provisioning_blocks [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Provisioning complete for port a14b0295-28ee-4633-b01e-44157c5f0b3b triggered by entity L2. {{(pid=103143) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 16:36:29.278792 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1387144'] for port, provisioning_complete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:29.311703 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-f3f4942e-fd44-40d3-9916-d4d5e9d43831 req-8dc18ee6-a70d-4c5f-84bb-08c9f2993806 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433843 Nov 24 16:36:29.354478 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:29.377517 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b'}] {{(pid=103143) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:36:29.379792 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}823eea1907d92035166eed732a46a8c150246aad8814c5e880c243ca256b1d21" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02ce9490-38e4-4380-8c25-b49081882347" -d '{"events": [{"server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "name": "network-vif-plugged", "status": "completed", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b"}]}' {{(pid=103143) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:36:29.390492 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:36:29.416921 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:36:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aab008b1-89a8-4a53-8236-f3034c8e1a44 x-openstack-request-id: req-aab008b1-89a8-4a53-8236-f3034c8e1a44 {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:36:29.417210 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "name": "network-vif-plugged", "status": "completed", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b", "code": 200}]} {{(pid=103143) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:36:29.417464 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-aab008b1-89a8-4a53-8236-f3034c8e1a44 {{(pid=103143) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:36:29.417853 dv-cinder-819007-2-iscsi neutron-server[103143]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'code': 200} Nov 24 16:36:29.437038 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726'] for port, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:29.488648 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Pushing event updated for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=5']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:29.782295 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6443d4f5-1e58-4748-96ca-8e6bb42a5eba req-f2d08528-a2c0-466f-99aa-e3509223fe63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:29.783810 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6443d4f5-1e58-4748-96ca-8e6bb42a5eba req-f2d08528-a2c0-466f-99aa-e3509223fe63 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1098 time: 0.0395424 Nov 24 16:36:29.829634 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-6443d4f5-1e58-4748-96ca-8e6bb42a5eba req-482c0913-839a-480b-a253-39de8d322467 service neutron] 10.222.0.84 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381558 Nov 24 16:36:30.421626 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d857f09a-f699-49c7-8844-519b65b1180e req-3e42bbd0-6436-48e9-9337-81b146c677d3 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:30.423065 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d857f09a-f699-49c7-8844-519b65b1180e req-3e42bbd0-6436-48e9-9337-81b146c677d3 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.0470064 Nov 24 16:36:30.474862 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-d857f09a-f699-49c7-8844-519b65b1180e req-bbdd0c89-19c6-407f-a3ee-c4b36572ae7e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450850 Nov 24 16:36:31.594973 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3adbc9a-4138-4bd5-86e3-ddef6ce12177 req-0d74e1b5-1c35-4712-afc1-af347af2d693 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:31.596446 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d3adbc9a-4138-4bd5-86e3-ddef6ce12177 req-0d74e1b5-1c35-4712-afc1-af347af2d693 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.0518982 Nov 24 16:36:31.644697 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-d3adbc9a-4138-4bd5-86e3-ddef6ce12177 req-62874aea-6d73-473b-9b44-389506773a50 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424623 Nov 24 16:36:31.754315 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdd1cc2-307a-474f-8298-25ee393d55a0 req-74d02edb-fd3a-4387-9e28-0d5548f85b63 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:31.755718 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1cdd1cc2-307a-474f-8298-25ee393d55a0 req-74d02edb-fd3a-4387-9e28-0d5548f85b63 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.0468850 Nov 24 16:36:31.804300 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-1cdd1cc2-307a-474f-8298-25ee393d55a0 req-4d742033-6d76-47a6-b55d-810eb4439a0e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416903 Nov 24 16:36:31.826321 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56708) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:36:31.862999 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33abde1b-62a4-4114-93e1-78e42b8f5004 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:31.864624 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-33abde1b-62a4-4114-93e1-78e42b8f5004 tempest-TestVolumeBootPattern-66892307 tempest-TestVolumeBootPattern-66892307-project-admin] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1093 time: 0.0373449 Nov 24 16:36:31.867818 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56710) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:36:31.872156 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.v2.base [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Request body: {'floatingip': {'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'port_id': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address': '172.20.0.7'}} {{(pid=103141) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 16:36:32.008317 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:32.106635 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:32.211296 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_common [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Allocated IP 172.27.2.32 (03b2fe8c-76ac-4bca-971e-09f45230a994/15e78730-137b-4455-919a-a8f2c37bf26d/c45faff5-c912-4326-9ac9-9efd19cb67b4) {{(pid=103141) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 16:36:32.310293 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:32.385657 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8778969727690', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:32.422342 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Network 03b2fe8c-76ac-4bca-971e-09f45230a994 is already hosted by enough agents. {{(pid=103141) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 16:36:32.430403 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.base_scheduler [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Resources bound (agent type, host, resource id): {{(pid=103141) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 16:36:32.433916 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Received port after_create {{(pid=103141) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 16:36:32.461237 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=c45faff5-c912-4326-9ac9-9efd19cb67b4,revision_number=1']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:32.474254 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.474607 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.474980 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.475322 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.476284 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.476631 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.476969 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.477304 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.477637 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.477966 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.478295 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.478621 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:36:32.807174 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:32.915327 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1558408'] for port, before_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:33.062404 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for port, precommit_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:33.122767 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8778970144714', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8778969727708', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8778969727726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25423610'] for port, after_update {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:33.197270 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event updated for resources: {'Port': ['ID=c45faff5-c912-4326-9ac9-9efd19cb67b4,revision_number=2']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:36:33.209336 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3810105'] for floatingip, after_create {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:33.308824 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP 0aa77232-927d-46bb-9479-342e38281927 associated. External IP: 172.27.2.32, port: a14b0295-28ee-4633-b01e-44157c5f0b3b. Nov 24 16:36:33.518066 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:36:33.626469 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:36:33.637252 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:36:33.648931 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:36:33.649543 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:36:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:36:33.714285 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:33.754853 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4caefb04-1fd4-4964-93cd-66c3788e6b9c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8859744 Nov 24 16:36:33.755469 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:36:33.758378 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3" -d '{"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:36:33.763331 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:36:33.960176 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:36:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c680c32f-6541-4403-abbd-5d2d90153869 x-openstack-request-id: req-c680c32f-6541-4403-abbd-5d2d90153869 {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:36:33.960712 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:36:33.960712 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-c680c32f-6541-4403-abbd-5d2d90153869 {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:36:33.961105 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'status': 'completed', 'code': 200} Nov 24 16:36:34.014642 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '0aa77232-927d-46bb-9479-342e38281927', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.32', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:f5:21:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '176d8748-e545-4387-98bb-7d8552a773cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:36:32Z', 'updated_at': '2021-11-24T16:36:32Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}, {'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:36:34.025664 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-3c1af16b-115a-4b24-979c-acf631dcf39a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:34.027113 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-3c1af16b-115a-4b24-979c-acf631dcf39a service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1098 time: 0.0415659 Nov 24 16:36:34.051641 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:36:34.062956 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:36:34.063581 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:36:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:36:34.156987 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-b61510f7-c728-4440-96ff-773473768dd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:34.158781 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-b61510f7-c728-4440-96ff-773473768dd6 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.1242146 Nov 24 16:36:34.190640 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:36:34.228363 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-ab579dde-4676-4220-84cf-cd3617c3602f service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 200 len: 998 time: 0.0615242 Nov 24 16:36:34.277709 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-94b4ae4b-b9e1-47ce-b668-83f8467e252d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:34.279143 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-94b4ae4b-b9e1-47ce-b668-83f8467e252d service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0432382 Nov 24 16:36:34.327590 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-f7e19186-b48d-4d14-8217-1910d786043d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:34.329070 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-f7e19186-b48d-4d14-8217-1910d786043d service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433121 Nov 24 16:36:34.415128 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '0aa77232-927d-46bb-9479-342e38281927', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.32', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:f5:21:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '176d8748-e545-4387-98bb-7d8552a773cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:36:32Z', 'updated_at': '2021-11-24T16:36:32Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}, {'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:36:34.419884 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-5bc5ae82-c31c-429c-968d-ecb69ceb9c91 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815811 Nov 24 16:36:34.447796 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8feeba38-ac24-44ce-aab3-6a51d07b75a1 None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': '0aa77232-927d-46bb-9479-342e38281927', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.32', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:f5:21:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '176d8748-e545-4387-98bb-7d8552a773cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:36:32Z', 'updated_at': '2021-11-24T16:36:32Z', 'revision_number': 0, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}, {'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:36:34.521602 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-87aaa342-a6ca-49de-9f96-9b0e1ad697c3 req-4580c030-79db-49c6-9a6f-02630b27caa2 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937119 Nov 24 16:36:34.638118 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04046dfa-38dc-4a63-92a9-bd859c783bbf None None] New status for floating IP 0aa77232-927d-46bb-9479-342e38281927: ACTIVE {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:36:35.279962 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-e005e759-99f5-4ea9-9829-b0ce7bfee238 service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0405257 Nov 24 16:36:35.358710 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8a5401-d879-4435-af81-dd60d1751510 req-06b6080d-869f-4371-94f5-af91d802acca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:35.360099 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-06b6080d-869f-4371-94f5-af91d802acca service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0389357 Nov 24 16:36:35.467785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8a5401-d879-4435-af81-dd60d1751510 req-7ace1766-d1c4-434c-bc5e-5a507cae8ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:35.469250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-7ace1766-d1c4-434c-bc5e-5a507cae8ca4 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0880384 Nov 24 16:36:35.533150 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-03da3411-8b70-440f-8ecc-8af378b83980 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 1001 time: 0.0564172 Nov 24 16:36:35.586213 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8a5401-d879-4435-af81-dd60d1751510 req-d0c4da6d-810e-490d-8281-1f21e761155a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:35.587729 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-d0c4da6d-810e-490d-8281-1f21e761155a service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0465448 Nov 24 16:36:35.633286 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8a5401-d879-4435-af81-dd60d1751510 req-2452c9db-d96b-4499-974a-ebd906f79c6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:36:35.634636 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-2452c9db-d96b-4499-974a-ebd906f79c6e service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390131 Nov 24 16:36:35.723731 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-bdbec968-78b6-4608-ae56-fe7af0ae5c17 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802798 Nov 24 16:36:35.815376 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-2f8a5401-d879-4435-af81-dd60d1751510 req-5509d140-bb99-469e-b4bf-925dcbe7aadd service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841327 Nov 24 16:36:46.922635 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-dd8c3084-fc91-4794-836e-60fde42a87a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:49.270619 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a9dc9248-707c-4275-82eb-9792f46b4b88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:50.436897 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:51.768140 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:52.488164 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:36:59.162275 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:02.141584 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:37:16.898823 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9492a92d-97fc-46f1-a044-c1204eebb691 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:19.281861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-cfa3d52e-a0dc-41cf-b6c0-7157377959be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:20.401291 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:21.772738 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:22.430548 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:29.150334 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:35.260416 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-9f369115-424d-4d51-8d90-d508306e481b service neutron] 10.222.0.84 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0456007 Nov 24 16:37:35.321233 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-84bb863a-cca6-4ede-b85d-317e8f57a8b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:37:35.328590 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-84bb863a-cca6-4ede-b85d-317e8f57a8b1 service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1098 time: 0.0401073 Nov 24 16:37:35.427173 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-7907fe8f-2e72-4f5e-aaa7-f6d1d0b711d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:37:35.428532 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-7907fe8f-2e72-4f5e-aaa7-f6d1d0b711d1 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0870905 Nov 24 16:37:35.495922 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-a300b20d-f02d-485c-b8ff-ee1e61b8c8ad service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 200 len: 1000 time: 0.0593586 Nov 24 16:37:35.549410 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-525da8a9-99f8-4060-a220-3865788cc3f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:37:35.550842 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-525da8a9-99f8-4060-a220-3865788cc3f3 service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0466487 Nov 24 16:37:35.598899 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-eabcd11c-2c06-466c-8b3a-68875bbf43d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:37:35.600800 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-eabcd11c-2c06-466c-8b3a-68875bbf43d4 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428479 Nov 24 16:37:35.705250 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-5aa1d3cb-f036-45d9-947b-f4749150d9ed service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973115 Nov 24 16:37:35.802357 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-1636c355-ec37-44ce-9d35-3d5c662304f4 req-eea63d72-bd32-492f-a385-cf548d0936cf service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886874 Nov 24 16:37:39.140496 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:37:46.903596 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-2dce63cf-bf08-417c-9db4-b019ad6b9943 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:49.263913 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-735aba97-c2cd-41ae-95a9-d48a6b0d117c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:50.406311 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:51.760861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:52.435269 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:37:54.787929 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [req-cbbc2aeb-c417-4359-b1ac-5e31bee64971 req-a5644a63-9469-421a-acd5-a9b6c632a4aa service neutron] (103141) timed out ('10.222.0.84', 52614) {{(pid=103141) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:37:55.451861 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-33a5050e-6424-4b30-9572-cbee95c35306 req-61cb0a40-cc6d-401e-90c4-64474a498651 service neutron] (103142) timed out ('10.222.0.84', 52631) {{(pid=103142) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:37:59.166510 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.034839 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56750) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:05.253926 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port c45faff5-c912-4326-9ac9-9efd19cb67b4 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:05.254271 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.328114 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.328361 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.339764 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for c45faff5-c912-4326-9ac9-9efd19cb67b4 owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:05.526270 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.548700 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=c45faff5-c912-4326-9ac9-9efd19cb67b4,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:05.559196 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.559577 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.559923 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.560261 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.560597 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.561298 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.561298 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.561553 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.561892 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.562201 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.562527 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.562918 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103141) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:05.624410 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.624668 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP 0aa77232-927d-46bb-9479-342e38281927 disassociated (deleted). External IP: 172.27.2.32, port: a14b0295-28ee-4633-b01e-44157c5f0b3b. Nov 24 16:38:05.832055 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:38:05.937865 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:38:05.946422 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:05.947444 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:38:05.957061 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:05.957696 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:37:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:06.206115 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:06.212237 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-14ee86cb-f5c9-4476-b2cd-2fc3cd115617 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "DELETE /v2.0/floatingips/0aa77232-927d-46bb-9479-342e38281927 HTTP/1.1" status: 204 len: 168 time: 1.1762846 Nov 24 16:38:06.212860 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:38:06.215047 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322" -d '{"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:38:06.255090 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:38:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-515eca67-709d-4f9a-a039-ae109fb3f63e x-openstack-request-id: req-515eca67-709d-4f9a-a039-ae109fb3f63e {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:38:06.255379 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:38:06.255633 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-515eca67-709d-4f9a-a039-ae109fb3f63e {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:38:06.256035 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'status': 'completed', 'code': 200} Nov 24 16:38:06.320419 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-26b787ab-0e58-46f1-90bd-f327c129d74f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:06.321905 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-26b787ab-0e58-46f1-90bd-f327c129d74f service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 1098 time: 0.0406222 Nov 24 16:38:06.427034 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-cfd50fba-c58f-4bab-ad71-5dd98a066715 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:06.428736 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-cfd50fba-c58f-4bab-ad71-5dd98a066715 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.0997605 Nov 24 16:38:06.443566 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:06.473901 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-9dcdb50c-6d1d-4c4c-94ff-62923da01d48 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 200 len: 217 time: 0.0378876 Nov 24 16:38:06.488818 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:38:06.497166 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:06.497778 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:37:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:06.528287 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-cdbd27ac-abc0-4174-be42-90acadae304c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:06.529827 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-cdbd27ac-abc0-4174-be42-90acadae304c service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0488901 Nov 24 16:38:06.580385 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-3784e36d-f57f-44dd-b832-28576735e338 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:06.581908 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-3784e36d-f57f-44dd-b832-28576735e338 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0436780 Nov 24 16:38:06.605647 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:06.711587 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff38ff88-b7f4-4138-a289-434d9b4ae3af req-3424eaaf-1317-4768-bf7a-c36bc62a6298 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:06.713342 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ff38ff88-b7f4-4138-a289-434d9b4ae3af req-3424eaaf-1317-4768-bf7a-c36bc62a6298 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.1037910 Nov 24 16:38:06.720237 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-58d923fb-b7ba-40db-af21-140728a6578a service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1285086 Nov 24 16:38:06.843473 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-ff38ff88-b7f4-4138-a289-434d9b4ae3af req-861bbfe5-a6ab-4f2c-9557-a2c0f29a0cf1 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1142509 Nov 24 16:38:06.866331 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-cdf6ece9-3cfb-43ce-aff7-e16fc5f32322 req-9b2d1abf-44c9-4ff7-be52-e85045fa8e30 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1359785 Nov 24 16:38:06.866582 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:06.892907 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13123a23-a0f0-419f-bbcd-435cc976ed2b None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_floatingips': [{'id': 'e2ecba29-6613-4b2d-b7f4-b06518df25bb', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'floating_ip_address': '172.27.2.251', 'floating_network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'router_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'port_id': '598a586c-3aae-4fa0-940c-be701011d838', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'mac_address': 'fa:16:3e:1c:2c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T16:34:34Z', 'updated_at': '2021-11-24T16:34:36Z', 'revision_number': 1, 'project_id': '3b37384f944943228da7761c28d2688c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:38:07.122686 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75735291-eda7-400a-bdbc-3077c3c16949 None None] New status for floating IP 0aa77232-927d-46bb-9479-342e38281927: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:38:07.954191 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b810e0-d479-4d32-80f7-84ee181fdab0 req-4d146c70-393c-47c3-ba1f-dae46bd6a47c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:07.955701 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-14b810e0-d479-4d32-80f7-84ee181fdab0 req-4d146c70-393c-47c3-ba1f-dae46bd6a47c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.0493505 Nov 24 16:38:08.003726 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-14b810e0-d479-4d32-80f7-84ee181fdab0 req-1beab557-aed5-49cc-831a-213ea17b7856 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421150 Nov 24 16:38:08.150237 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-a7a65b59-841b-413f-b818-713709b2224c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:08.151666 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-a7a65b59-841b-413f-b818-713709b2224c tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 945 time: 0.0471652 Nov 24 16:38:08.237668 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port a14b0295-28ee-4633-b01e-44157c5f0b3b {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:08.238009 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:08.325885 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] For port a14b0295-28ee-4633-b01e-44157c5f0b3b, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=a14b0295-28ee-4633-b01e-44157c5f0b3b,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:08.326250 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:08.338209 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for a14b0295-28ee-4633-b01e-44157c5f0b3b owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:08.526442 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:08.554098 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=a14b0295-28ee-4633-b01e-44157c5f0b3b,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:08.580562 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.582625 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.583210 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.583210 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.583495 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.583758 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.584076 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103142) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:08.603124 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] No DVR routers for this DVR port a14b0295-28ee-4633-b01e-44157c5f0b3b on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:08.605401 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:08.608698 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-7747fc46-665a-4db8-9e82-e5a64e4526e2 req-cc2f8529-0117-4728-af80-0e586b6af1dd tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "DELETE /v2.0/ports/a14b0295-28ee-4633-b01e-44157c5f0b3b HTTP/1.1" status: 204 len: 173 time: 0.4508467 Nov 24 16:38:08.609120 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'name': 'network-vif-deleted', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:38:08.611344 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e226571d-f269-4713-a5d0-92c8ba85f29f" -d '{"events": [{"server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "name": "network-vif-deleted", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:38:08.645815 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:38:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aa5c37f-0881-4745-890e-5b4862197d11 x-openstack-request-id: req-1aa5c37f-0881-4745-890e-5b4862197d11 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:38:08.646114 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "176d8748-e545-4387-98bb-7d8552a773cb", "name": "network-vif-deleted", "tag": "a14b0295-28ee-4633-b01e-44157c5f0b3b", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:38:08.646373 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-1aa5c37f-0881-4745-890e-5b4862197d11 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:38:08.646793 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '176d8748-e545-4387-98bb-7d8552a773cb', 'name': 'network-vif-deleted', 'tag': 'a14b0295-28ee-4633-b01e-44157c5f0b3b', 'status': 'completed', 'code': 200} Nov 24 16:38:09.099847 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-4b36ffe3-4ac2-4d18-be4b-43114c27d1a5 req-b8d75a2a-78ed-4bd7-bb1b-f0d60dae96b1 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=176d8748-e545-4387-98bb-7d8552a773cb HTTP/1.1" status: 200 len: 210 time: 0.0302954 Nov 24 16:38:11.710322 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a14b0295-28ee-4633-b01e-44157c5f0b3b no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:11.734097 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: a14b0295-28ee-4633-b01e-44157c5f0b3b {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:11.734437 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device a14b0295-28ee-4633-b01e-44157c5f0b3b not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:12.607546 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56794) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:12.762897 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port 8c73fa2a-4097-4b0a-88c5-f3c68ee8362e {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:12.763252 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:12.837238 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:12.838981 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:12.848989 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for 8c73fa2a-4097-4b0a-88c5-f3c68ee8362e owned by network:floatingip {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:13.063156 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:13.093043 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=8c73fa2a-4097-4b0a-88c5-f3c68ee8362e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:13.153930 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:13.154263 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.db.l3_db [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Floating IP e2ecba29-6613-4b2d-b7f4-b06518df25bb disassociated (deleted). External IP: 172.27.2.251, port: 598a586c-3aae-4fa0-940c-be701011d838. Nov 24 16:38:13.356411 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:38:13.458266 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:38:13.463206 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:13.467564 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:38:13.476554 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:13.477163 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:37:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:13.491441 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-4caac53c-e112-497d-91f5-fd1dea3b5630 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "DELETE /v2.0/floatingips/e2ecba29-6613-4b2d-b7f4-b06518df25bb HTTP/1.1" status: 204 len: 168 time: 0.8828108 Nov 24 16:38:13.492033 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838'}] {{(pid=103141) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:38:13.494772 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8b23f39844921ececaa6ed2ecd50aff72fd5221d27cd1b9c6ed8a56bd226772" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8" -d '{"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838"}]}' {{(pid=103141) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:38:13.531747 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 16:38:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-554a54e6-591a-4302-a33f-33fb21d4a851 x-openstack-request-id: req-554a54e6-591a-4302-a33f-33fb21d4a851 {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:38:13.532040 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "tag": "598a586c-3aae-4fa0-940c-be701011d838", "status": "completed", "code": 200}]} {{(pid=103141) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:38:13.532294 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-554a54e6-591a-4302-a33f-33fb21d4a851 {{(pid=103141) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:38:13.532698 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'tag': '598a586c-3aae-4fa0-940c-be701011d838', 'status': 'completed', 'code': 200} Nov 24 16:38:13.591550 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:13.595226 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-e5297fca-a3d2-44c7-9a18-bfb204af25dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:13.596751 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-e5297fca-a3d2-44c7-9a18-bfb204af25dd service neutron] 10.222.0.84 "GET /v2.0/ports?tenant_id=3b37384f944943228da7761c28d2688c&device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 1098 time: 0.0417366 Nov 24 16:38:13.802016 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:13.838942 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:38:13.846595 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:13.847260 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:37:49Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:13.951468 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:13.986499 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-01f936fc-d1f8-478c-97f9-22ae141b0e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:13.988017 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-01f936fc-d1f8-478c-97f9-22ae141b0e70 service neutron] 10.222.0.84 "GET /v2.0/networks?id=d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 200 len: 913 time: 0.3819573 Nov 24 16:38:13.995941 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658cc2e9-7034-4d4b-bd3d-8ee88e0eb725 req-a04e5bdd-b011-47fa-8cac-b6197f2115c3 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:13.997321 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-658cc2e9-7034-4d4b-bd3d-8ee88e0eb725 req-a04e5bdd-b011-47fa-8cac-b6197f2115c3 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0686851 Nov 24 16:38:14.044826 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-3e1cd126-4d25-4bff-8faf-5021a4ed21a7 service neutron] 10.222.0.84 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 200 len: 217 time: 0.0465705 Nov 24 16:38:14.104534 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-658cc2e9-7034-4d4b-bd3d-8ee88e0eb725 req-0979ce3e-1437-4497-84dd-29241f53260e tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1008329 Nov 24 16:38:14.120083 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-1579a99b-7a5a-436d-9af6-390b5ea6f41b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:14.121540 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-1579a99b-7a5a-436d-9af6-390b5ea6f41b service neutron] 10.222.0.84 "GET /v2.0/subnets?id=ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 200 len: 851 time: 0.0643752 Nov 24 16:38:14.151382 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:14.167969 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-70f0ffd6-64ce-4aee-87a5-5cd69656e4a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:14.169434 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-70f0ffd6-64ce-4aee-87a5-5cd69656e4a9 service neutron] 10.222.0.84 "GET /v2.0/ports?network_id=d5daf004-999b-4292-8917-46525a8f363e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394509 Nov 24 16:38:14.177304 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3721795b-f6d2-47e9-8504-5e777059a27a None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:31:28Z', 'revision_number': 4, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi', '_interfaces': [{'id': '136d5333-b159-4ef7-a144-e7d1ca8b998e', 'name': '', 'network_id': 'd5daf004-999b-4292-8917-46525a8f363e', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'mac_address': 'fa:16:3e:4f:0c:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:28Z', 'updated_at': '2021-11-24T16:31:32Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'subnets': [{'id': 'ed51ff75-126f-45c3-ab4f-52644e5c0709', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:38:14.268433 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-9a3e2062-bf6d-409e-8d0f-2f191e0b3d26 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886235 Nov 24 16:38:14.362825 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-8b78d814-8d30-4b8b-9e12-a5f8c851cfa8 req-8eb4dcb0-f6a5-4040-a097-d04e3ac05bc5 service neutron] 10.222.0.84 "GET /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852485 Nov 24 16:38:14.392224 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c69ca939-de48-4e02-9e9a-0c98200376fb None None] New status for floating IP e2ecba29-6613-4b2d-b7f4-b06518df25bb: DOWN {{(pid=103144) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 16:38:15.226390 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c4c7e5-82b9-450e-acc9-ae6325024304 req-e8a0e8f5-ca61-459e-a3b9-1b2fb29f6592 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103141) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:15.228523 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-60c4c7e5-82b9-450e-acc9-ae6325024304 req-e8a0e8f5-ca61-459e-a3b9-1b2fb29f6592 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0485692 Nov 24 16:38:15.275893 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-60c4c7e5-82b9-450e-acc9-ae6325024304 req-68e187b2-71b1-4c81-9efe-3a0ec4c5518d tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/security-groups?id=57111423-b7f2-4a51-99d9-39fc5eedc05d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416470 Nov 24 16:38:15.409235 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-bbe744a4-e173-4ab3-a92e-e1088fd092a9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103142) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 16:38:15.412674 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-bbe744a4-e173-4ab3-a92e-e1088fd092a9 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 945 time: 0.0553524 Nov 24 16:38:15.509319 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port 598a586c-3aae-4fa0-940c-be701011d838 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:15.509662 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:15.599048 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] For port 598a586c-3aae-4fa0-940c-be701011d838, host hv-cinder-81900, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81900',level=0,port_id=598a586c-3aae-4fa0-940c-be701011d838,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:15.599420 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:15.611062 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for 598a586c-3aae-4fa0-940c-be701011d838 owned by compute:nova {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:15.776631 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:15.809967 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=598a586c-3aae-4fa0-940c-be701011d838,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:15.855203 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] No DVR routers for this DVR port 598a586c-3aae-4fa0-940c-be701011d838 on host hv-cinder-81900 {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:15.857692 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for port, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:15.861088 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [req-e083f9f5-5e38-4695-82b2-33e1187e3816 req-255af8f5-1ebd-4a37-9c95-d1c909053250 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.84 "DELETE /v2.0/ports/598a586c-3aae-4fa0-940c-be701011d838 HTTP/1.1" status: 204 len: 173 time: 0.4406896 Nov 24 16:38:15.861529 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'name': 'network-vif-deleted', 'tag': '598a586c-3aae-4fa0-940c-be701011d838'}] {{(pid=103142) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 16:38:15.863858 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.82/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d2e46e986487b9368e36b0fb837474e8eec9bd6034c38399ac710cc13c547e3b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5492cd6f-885d-4bc2-a904-4c7493620716" -d '{"events": [{"server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "name": "network-vif-deleted", "tag": "598a586c-3aae-4fa0-940c-be701011d838"}]}' {{(pid=103142) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 16:38:15.898448 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 16:38:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8621975e-5968-4a69-9031-1861a3ff5908 x-openstack-request-id: req-8621975e-5968-4a69-9031-1861a3ff5908 {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 16:38:15.898764 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d63b3aa-cece-43f0-844f-182f53ca40b5", "name": "network-vif-deleted", "tag": "598a586c-3aae-4fa0-940c-be701011d838", "status": "completed", "code": 200}]} {{(pid=103142) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 16:38:15.899586 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.82/compute/v2.1/os-server-external-events used request id req-8621975e-5968-4a69-9031-1861a3ff5908 {{(pid=103142) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 16:38:15.899986 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d63b3aa-cece-43f0-844f-182f53ca40b5', 'name': 'network-vif-deleted', 'tag': '598a586c-3aae-4fa0-940c-be701011d838', 'status': 'completed', 'code': 200} Nov 24 16:38:16.140279 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:38:16.367238 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [req-0466d7f4-0faf-486c-8617-5047bcfcd07f req-512291d7-c78b-42e6-b4cb-53d3182fb710 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "GET /v2.0/ports?device_id=7d63b3aa-cece-43f0-844f-182f53ca40b5 HTTP/1.1" status: 200 len: 210 time: 0.0251925 Nov 24 16:38:16.920740 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-055b8be8-baea-430d-8a7f-47ed8e331d35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.420527 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56810) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:17.541376 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Deleting port 5698d8d0-b76b-461e-978b-d3c856fbcb36 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:17.541713 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.617405 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.618293 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.629753 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Calling delete_port for 5698d8d0-b76b-461e-978b-d3c856fbcb36 owned by network:floatingip {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:17.740785 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 598a586c-3aae-4fa0-940c-be701011d838 no longer exists at agent hyperv_hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:17.763942 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] No Port match for: 598a586c-3aae-4fa0-940c-be701011d838 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:17.764702 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Device 598a586c-3aae-4fa0-940c-be701011d838 not bound to the agent host hv-cinder-81900 {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:17.828967 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.858528 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'Port': ['ID=5698d8d0-b76b-461e-978b-d3c856fbcb36,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:17.917230 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for floatingip, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.919900 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-219728'] for floatingip, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:17.923612 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-3e6e735e-2244-49a9-897a-c532fd8665e6 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "DELETE /v2.0/floatingips/2a028410-b44e-419e-946e-8d5183117164 HTTP/1.1" status: 204 len: 168 time: 0.4995434 Nov 24 16:38:19.233586 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56822) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:19.269075 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-55dbf1ad-0e46-4b00-a7e1-46ca1021b6cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:19.290217 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:19.315762 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:19.429063 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:19.431571 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:19.432987 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] 10.222.0.82 "DELETE /v2.0/security-groups/57111423-b7f2-4a51-99d9-39fc5eedc05d HTTP/1.1" status: 204 len: 168 time: 0.1983616 Nov 24 16:38:19.449503 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2643bdc-8be3-4de7-a249-103e3a4f1371 tempest-TestVolumeBootPattern-1170210678 tempest-TestVolumeBootPattern-1170210678-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=57111423-b7f2-4a51-99d9-39fc5eedc05d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:19.555954 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56826) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:20.015035 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.264338 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Deleting port 136d5333-b159-4ef7-a144-e7d1ca8b998e {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:20.264675 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.340699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] For port 136d5333-b159-4ef7-a144-e7d1ca8b998e, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=136d5333-b159-4ef7-a144-e7d1ca8b998e,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:20.340959 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.352978 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Calling delete_port for 136d5333-b159-4ef7-a144-e7d1ca8b998e owned by network:router_interface {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:20.412087 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.583473 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.609243 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Pushing event deleted for resources: {'Port': ['ID=136d5333-b159-4ef7-a144-e7d1ca8b998e,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:20.773842 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:20.988458 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Router 88146987-20b4-4767-bd2d-292198f0b7a8 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:38:21.093024 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:38:21.102215 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Sync routers for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:38:21.102431 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56830) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:21.102860 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-e360b422-a207-4a82-8972-cb39209432ff admin admin] 10.222.0.82 "PUT /v2.0/routers/88146987-20b4-4767-bd2d-292198f0b7a8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5453415 Nov 24 16:38:21.114030 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:21.114661 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:38:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:21.216754 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks [] for router, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.219308 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:21.316162 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.397068 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69'}], 'enable_snat': True}, 'gw_port_id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:38:20Z', 'revision_number': 5, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port': {'id': '8a032bdb-52a8-4eff-ad41-d22dba1df794', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:0b:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:26Z', 'updated_at': '2021-11-24T16:31:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:21.423699 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Checking router: 88146987-20b4-4767-bd2d-292198f0b7a8 for host: dv-cinder-819007-2-iscsi {{(pid=103143) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:38:21.432178 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Routers {'88146987-20b4-4767-bd2d-292198f0b7a8'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103143) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:21.432816 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:38:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['88146987-20b4-4767-bd2d-292198f0b7a8'], 'active': True} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:21.434283 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Deleting port 8a032bdb-52a8-4eff-ad41-d22dba1df794 {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:21.434622 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.516424 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] For port 8a032bdb-52a8-4eff-ad41-d22dba1df794, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8a032bdb-52a8-4eff-ad41-d22dba1df794,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:21.516791 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.530678 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Calling delete_port for 8a032bdb-52a8-4eff-ad41-d22dba1df794 owned by network:router_gateway {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:21.644621 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvr_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] Set router 88146987-20b4-4767-bd2d-292198f0b7a8 gateway port host: None {{(pid=103143) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:21.696340 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_hamode_db [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:38:21Z', 'revision_number': 6, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103143) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:21.732325 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d35afc-da36-4026-a6f2-6cf411dd677c None None] The sync data for ids ['88146987-20b4-4767-bd2d-292198f0b7a8'] in dv-cinder-819007-2-iscsi is: [{'id': '88146987-20b4-4767-bd2d-292198f0b7a8', 'name': 'tempest-TestVolumeBootPattern-1071257930-router', 'tenant_id': '3b37384f944943228da7761c28d2688c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:25Z', 'updated_at': '2021-11-24T16:38:21Z', 'revision_number': 6, 'project_id': '3b37384f944943228da7761c28d2688c', 'gw_port_host': None}] {{(pid=103143) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:38:21.737941 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.771269 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Pushing event deleted for resources: {'Port': ['ID=8a032bdb-52a8-4eff-ad41-d22dba1df794,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:21.783306 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.831246 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.933728 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:21.935888 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.040362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.040829 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 88146987-20b4-4767-bd2d-292198f0b7a8 {{(pid=103142) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:38:22.049492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] Publish callbacks [] for router, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.049492 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-eccd081d-f5e1-44df-9e15-ddda4e2d94a8 admin admin] 10.222.0.82 "DELETE /v2.0/routers/88146987-20b4-4767-bd2d-292198f0b7a8 HTTP/1.1" status: 204 len: 168 time: 0.9435370 Nov 24 16:38:22.049492 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56832) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:22.100506 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.db_base_plugin_v2 [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Deleting subnet ed51ff75-126f-45c3-ab4f-52644e5c0709 {{(pid=103142) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:38:22.105036 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.144350 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-26204507'] for subnet, precommit_delete_associations {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.193409 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 136d5333-b159-4ef7-a144-e7d1ca8b998e no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:22.217617 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 136d5333-b159-4ef7-a144-e7d1ca8b998e {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:22.217964 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 136d5333-b159-4ef7-a144-e7d1ca8b998e not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:22.231362 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.332092 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-26164533', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25215990'] for subnet, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.359993 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ed51ff75-126f-45c3-ab4f-52644e5c0709,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:22.365821 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.369451 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-b33b7967-29e3-4986-a893-ea5ef3a132c1 admin admin] 10.222.0.82 "DELETE /v2.0/subnets/ed51ff75-126f-45c3-ab4f-52644e5c0709 HTTP/1.1" status: 204 len: 168 time: 0.3192070 Nov 24 16:38:22.371791 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc35c86f-6c85-4d40-ba55-5ccb7970e9f8 None None] Network d5daf004-999b-4292-8917-46525a8f363e requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:38:22.372589 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56834) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:22.442188 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.495692 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Deleting port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d {{(pid=103142) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:22.496038 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.528000 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.568785 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.db [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] For port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103142) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:22.569146 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.581858 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.plugin [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Calling delete_port for b90d1df9-fa7f-4603-96e6-c0bc6e22b15d owned by network:dhcp {{(pid=103142) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:22.591423 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] DHCP port deletion for d5daf004-999b-4292-8917-46525a8f363e request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:38:22.639184 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Deleting port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:22.639908 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.707397 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] For port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,segment=NetworkSegment(01daf12f-03fc-4264-b82d-d482465642e8),segment_id=01daf12f-03fc-4264-b82d-d482465642e8)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:22.707827 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.715403 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-26164550'] for port, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.723805 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Calling delete_port for b90d1df9-fa7f-4603-96e6-c0bc6e22b15d owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:22.748313 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Pushing event deleted for resources: {'Port': ['ID=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:22.750334 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] No DVR routers for this DVR port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d on host dv-cinder-819007-2-iscsi {{(pid=103142) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:22.804506 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.824816 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.831324 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Pushing event deleted for resources: {'Port': ['ID=b90d1df9-fa7f-4603-96e6-c0bc6e22b15d,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:22.839676 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] No DVR routers for this DVR port b90d1df9-fa7f-4603-96e6-c0bc6e22b15d on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:22.841900 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.845359 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.845798 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.846160 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.846513 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.846861 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.847456 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.847812 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.848157 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.849073 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.849967 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.851060 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67986aa-91d0-4dba-bd83-ab187799d215 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819007-2-iscsi {{(pid=103143) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 16:38:22.852463 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d5daf004-999b-4292-8917-46525a8f363e']}} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:22.870608 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01daf12f-03fc-4264-b82d-d482465642e8') {'for_net_delete': True} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:22.870968 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.services.segments.db [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01daf12f-03fc-4264-b82d-d482465642e8') {} {{(pid=103142) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:22.880754 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-26204524'] for segment, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.895399 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.902198 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Releasing vlan 892 on physical network physnet1 to pool {{(pid=103142) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:38:22.902582 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-26014103'] for segment, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: Traceback (most recent call last): Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: timer() Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: cb(*args, **kw) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: return func(*args, **kwargs) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: self._notify() Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: self.callback(batched_events) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: event.method(event) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: return f(self, *a, **k) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._get(url).json() Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: return self.request(url, 'GET', **kwargs) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:38:22.904492 dv-cinder-819007-2-iscsi neutron-server[103142]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:38:23.023151 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:23.029122 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:23.032676 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] 10.222.0.82 "DELETE /v2.0/networks/d5daf004-999b-4292-8917-46525a8f363e HTTP/1.1" status: 204 len: 168 time: 0.6586673 Nov 24 16:38:23.035499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56836) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:23.042680 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35639f6a-fe9d-4f8c-a07c-6ea393dd950d admin admin] Pushing event deleted for resources: {'Network': ['ID=d5daf004-999b-4292-8917-46525a8f363e,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:23.591917 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3810617'] for router_interface, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:23.852689 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Deleting port 6070f394-07a3-4f7c-bcc4-27f85a829749 {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:23.852938 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:23.933679 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] For port 6070f394-07a3-4f7c-bcc4-27f85a829749, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=6070f394-07a3-4f7c-bcc4-27f85a829749,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:23.934048 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:23.947194 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Calling delete_port for 6070f394-07a3-4f7c-bcc4-27f85a829749 owned by network:router_interface {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:23.977528 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b90d1df9-fa7f-4603-96e6-c0bc6e22b15d no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:24.001677 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: b90d1df9-fa7f-4603-96e6-c0bc6e22b15d {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:24.002107 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device b90d1df9-fa7f-4603-96e6-c0bc6e22b15d not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:24.002587 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8a032bdb-52a8-4eff-ad41-d22dba1df794 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:24.020728 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 8a032bdb-52a8-4eff-ad41-d22dba1df794 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:24.021155 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8a032bdb-52a8-4eff-ad41-d22dba1df794 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:24.183553 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:24.206953 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Pushing event deleted for resources: {'Port': ['ID=6070f394-07a3-4f7c-bcc4-27f85a829749,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:24.377932 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3642671', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3810725'] for router_interface, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:24.586699 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Router 25763a8c-3524-4cc2-b11e-226895f1ac53 has already been hosted by L3 agent 5191e426-3849-4824-8e73-5d3ce7c3e91e {{(pid=103141) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 16:38:24.690322 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] Notify agent at l3_agent.dv-cinder-819007-2-iscsi the message routers_updated {{(pid=103141) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 16:38:24.695472 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-217906ee-4fc6-4e08-9cb0-902741124714 admin admin] 10.222.0.82 "PUT /v2.0/routers/25763a8c-3524-4cc2-b11e-226895f1ac53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6589506 Nov 24 16:38:24.698574 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56838) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:24.701224 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Sync routers for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 16:38:24.711280 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:24.711894 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:38:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:24.799152 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks [] for router, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:24.817554 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: dv-cinder-819007-2-iscsi {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:24.899990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:24.990481 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'external_fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:38:24Z', 'revision_number': 5, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port': {'id': '0535eb8a-a115-4960-a1f7-8c6251a0128c', 'name': '', 'network_id': '03b2fe8c-76ac-4bca-971e-09f45230a994', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:8b:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819007-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T16:31:32Z', 'updated_at': '2021-11-24T16:31:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '15e78730-137b-4455-919a-a8f2c37bf26d', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819007-2-iscsi'}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:25.002235 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Deleting port 0535eb8a-a115-4960-a1f7-8c6251a0128c {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:25.002581 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.017220 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Checking router: 25763a8c-3524-4cc2-b11e-226895f1ac53 for host: dv-cinder-819007-2-iscsi {{(pid=103144) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 16:38:25.025188 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Routers {'25763a8c-3524-4cc2-b11e-226895f1ac53'} bound to L3 agent in host dv-cinder-819007-2-iscsi {{(pid=103144) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 16:38:25.025787 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819007-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T16:14:19Z,description=,heartbeat_timestamp=2021-11-24T16:38:19Z,host='dv-cinder-819007-2-iscsi',id=5191e426-3849-4824-8e73-5d3ce7c3e91e,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T16:14:20Z,topic='l3_agent')) {'router_ids': ['25763a8c-3524-4cc2-b11e-226895f1ac53'], 'active': True} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:25.083435 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] For port 0535eb8a-a115-4960-a1f7-8c6251a0128c, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=0535eb8a-a115-4960-a1f7-8c6251a0128c,segment=NetworkSegment(890dc0fb-5bd2-483a-82f2-fe5aa7d3675c),segment_id=890dc0fb-5bd2-483a-82f2-fe5aa7d3675c)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:25.083806 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.095363 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Calling delete_port for 0535eb8a-a115-4960-a1f7-8c6251a0128c owned by network:router_gateway {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:25.112372 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_dvr_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] Set router 25763a8c-3524-4cc2-b11e-226895f1ac53 gateway port host: None {{(pid=103144) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 16:38:25.172408 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.l3_hamode_db [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:38:24Z', 'revision_number': 6, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port_host': None}], 'dv-cinder-819007-2-iscsi', False) {} {{(pid=103144) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:25.198499 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fa522ca-84a1-4dd6-87a8-2d538ad6686b None None] The sync data for ids ['25763a8c-3524-4cc2-b11e-226895f1ac53'] in dv-cinder-819007-2-iscsi is: [{'id': '25763a8c-3524-4cc2-b11e-226895f1ac53', 'name': 'tempest-TestVolumeBootPattern-390472717-router', 'tenant_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T16:31:31Z', 'updated_at': '2021-11-24T16:38:24Z', 'revision_number': 6, 'project_id': '90dddcb32d9747c8a90b8ad9fbd47ef8', 'gw_port_host': None}] {{(pid=103144) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 16:38:25.297231 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.321225 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Pushing event deleted for resources: {'Port': ['ID=0535eb8a-a115-4960-a1f7-8c6251a0128c,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:25.380868 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3810051'] for router_gateway, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.469119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3810637', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13975'] for router, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.471144 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.566065 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-3810177'] for router, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.566608 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 25763a8c-3524-4cc2-b11e-226895f1ac53 {{(pid=103141) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 16:38:25.574932 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] Publish callbacks [] for router, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.574932 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-9fe795fa-3032-4ae3-ae8e-dd2c87443d2a admin admin] 10.222.0.82 "DELETE /v2.0/routers/25763a8c-3524-4cc2-b11e-226895f1ac53 HTTP/1.1" status: 204 len: 168 time: 0.8727667 Nov 24 16:38:25.575242 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56840) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:25.620503 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Deleting subnet ca402e9d-3db8-40f8-baec-fffd914af1aa {{(pid=103141) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 16:38:25.623851 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.658285 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25189480'] for subnet, precommit_delete_associations {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.736560 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1396926'] for subnet, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.869006 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1397581', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798676', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25423536', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25555699'] for subnet, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.894061 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ca402e9d-3db8-40f8-baec-fffd914af1aa,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:25.897684 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for subnet, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:25.900849 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-b0cc6643-0129-466d-8e67-1a5598932b2c admin admin] 10.222.0.82 "DELETE /v2.0/subnets/ca402e9d-3db8-40f8-baec-fffd914af1aa HTTP/1.1" status: 204 len: 168 time: 0.3248453 Nov 24 16:38:25.903990 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.wsgi [-] (103141) accepted ('10.222.0.82', 56842) {{(pid=103141) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:25.906489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbc1ad6a-b1e5-4b59-89ab-4176c226a046 None None] Network 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 requested from dv-cinder-819007-2-iscsi {{(pid=103143) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 16:38:25.980578 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1541287'] for network, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.005884 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0535eb8a-a115-4960-a1f7-8c6251a0128c no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:26.039499 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Deleting port 8731ae86-043a-4cb2-9872-94ab32e5f3db {{(pid=103141) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:26.039847 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.041056 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 0535eb8a-a115-4960-a1f7-8c6251a0128c {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:26.041404 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 0535eb8a-a115-4960-a1f7-8c6251a0128c not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:26.041859 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 6070f394-07a3-4f7c-bcc4-27f85a829749 no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:26.066179 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 6070f394-07a3-4f7c-bcc4-27f85a829749 {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:26.066839 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 6070f394-07a3-4f7c-bcc4-27f85a829749 not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:26.109067 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.db [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] For port 8731ae86-043a-4cb2-9872-94ab32e5f3db, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8731ae86-043a-4cb2-9872-94ab32e5f3db,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103141) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:26.109435 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.122848 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.plugin [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Calling delete_port for 8731ae86-043a-4cb2-9872-94ab32e5f3db owned by network:dhcp {{(pid=103141) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:26.140209 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] DHCP port deletion for 5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 request from dv-cinder-819007-2-iscsi {{(pid=103143) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 16:38:26.194082 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Deleting port 8731ae86-043a-4cb2-9872-94ab32e5f3db {{(pid=103143) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 16:38:26.194489 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8778970143326'] for port, before_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.259546 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.db [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] For port 8731ae86-043a-4cb2-9872-94ab32e5f3db, host dv-cinder-819007-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819007-2-iscsi',level=0,port_id=8731ae86-043a-4cb2-9872-94ab32e5f3db,segment=NetworkSegment(16ac500b-6232-434f-893b-d3baa2e29d82),segment_id=16ac500b-6232-434f-893b-d3baa2e29d82)] {{(pid=103143) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 16:38:26.259882 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3816478'] for port, precommit_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.264011 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25423555'] for port, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.272818 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Calling delete_port for 8731ae86-043a-4cb2-9872-94ab32e5f3db owned by network:dhcp {{(pid=103143) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 16:38:26.288806 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Pushing event deleted for resources: {'Port': ['ID=8731ae86-043a-4cb2-9872-94ab32e5f3db,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:26.292388 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] No DVR routers for this DVR port 8731ae86-043a-4cb2-9872-94ab32e5f3db on host dv-cinder-819007-2-iscsi {{(pid=103141) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:26.353031 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1560397', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-112576', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8778970144368', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8778969727699'] for port, after_delete {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.365096 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1388129', 'neutron.services.segments.db._delete_segments_for_network-8778970271928'] for network, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.375869 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] Pushing event deleted for resources: {'Port': ['ID=8731ae86-043a-4cb2-9872-94ab32e5f3db,revision_number=None']} {{(pid=103143) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:26.381451 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.db.l3_dvrscheduler_db [None req-840dbe0d-1609-4d02-a0a4-119dc7b797f9 None None] No DVR routers for this DVR port 8731ae86-043a-4cb2-9872-94ab32e5f3db on host dv-cinder-819007-2-iscsi {{(pid=103143) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 16:38:26.386434 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5da62686-a1fb-4288-ae81-9fdc2d8f7dd3']}} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:26.396436 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16ac500b-6232-434f-893b-d3baa2e29d82') {'for_net_delete': True} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:26.396632 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.services.segments.db [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16ac500b-6232-434f-893b-d3baa2e29d82') {} {{(pid=103141) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 16:38:26.406346 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8778970233676', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25189471'] for segment, before_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.420420 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635'] for segment, precommit_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.426119 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Releasing vlan 873 on physical network physnet1 to pool {{(pid=103141) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 16:38:26.427392 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1397635', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25174546'] for segment, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: Traceback (most recent call last): Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: timer() Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: cb(*args, **kw) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: return func(*args, **kwargs) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: self._notify() Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: self.callback(batched_events) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: event.method(event) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: return f(self, *a, **k) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._get(url).json() Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: return self.request(url, 'GET', **kwargs) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 16:38:26.428107 dv-cinder-819007-2-iscsi neutron-server[103141]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 16:38:26.537377 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1388118', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3798735', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3642662', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3810087'] for network, after_delete {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.542840 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron_lib.callbacks.manager [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3642676'] for network, before_response {{(pid=103141) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.546037 dv-cinder-819007-2-iscsi neutron-server[103141]: INFO neutron.wsgi [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] 10.222.0.82 "DELETE /v2.0/networks/5da62686-a1fb-4288-ae81-9fdc2d8f7dd3 HTTP/1.1" status: 204 len: 168 time: 0.6411273 Nov 24 16:38:26.556427 dv-cinder-819007-2-iscsi neutron-server[103141]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d677ce37-ff49-4e2b-a8f8-e8444567828a admin admin] Pushing event deleted for resources: {'Network': ['ID=5da62686-a1fb-4288-ae81-9fdc2d8f7dd3,revision_number=None']} {{(pid=103141) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:26.793307 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56846) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:26.833006 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-c08af502-924f-4cb2-8c76-54e85c7ee11d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=3b37384f944943228da7761c28d2688c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0385695 Nov 24 16:38:26.835378 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56848) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:26.881193 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:26.901858 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.000032 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.002721 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.003919 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/643892f7-4b45-4ee5-81f2-6e0ee2ea4eed HTTP/1.1" status: 204 len: 168 time: 0.1676655 Nov 24 16:38:27.011798 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5082014f-17c5-4a56-b4e3-c0a67466c21d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=643892f7-4b45-4ee5-81f2-6e0ee2ea4eed,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:27.655958 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56854) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:27.695254 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-5a29c9b6-d30f-4b88-a916-241ea17d1e6d admin admin] 10.222.0.82 "GET /v2.0/security-groups?tenant_id=90dddcb32d9747c8a90b8ad9fbd47ef8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0380108 Nov 24 16:38:27.697713 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [-] (103142) accepted ('10.222.0.82', 56856) {{(pid=103142) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 16:38:27.743086 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.764508 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.857104 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3736103'] for security_group, after_delete {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.859731 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron_lib.callbacks.manager [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103142) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:27.860875 dv-cinder-819007-2-iscsi neutron-server[103142]: INFO neutron.wsgi [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] 10.222.0.82 "DELETE /v2.0/security-groups/71374cb9-4693-414a-b210-82c23cf9eaf5 HTTP/1.1" status: 204 len: 168 time: 0.1616588 Nov 24 16:38:27.868688 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8396dbb5-cc81-4318-944c-6f8889a097f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71374cb9-4693-414a-b210-82c23cf9eaf5,revision_number=None']} {{(pid=103142) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 16:38:27.991999 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8731ae86-043a-4cb2-9872-94ab32e5f3db no longer exists at agent ovs-agent-dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 16:38:28.013256 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.plugin [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] No Port match for: 8731ae86-043a-4cb2-9872-94ab32e5f3db {{(pid=103143) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 16:38:28.013605 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron.plugins.ml2.rpc [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Device 8731ae86-043a-4cb2-9872-94ab32e5f3db not bound to the agent host dv-cinder-819007-2-iscsi {{(pid=103143) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 16:38:29.194296 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:46.937060 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a57d8de9-d91c-4c70-b367-44e9a5597064 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:49.268401 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fed7fff2-620d-4fb4-bc42-cb017ba3d812 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:50.422818 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:51.782183 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:52.456595 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:38:53.139898 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:38:59.171463 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:16.913803 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-9784a65d-589c-4ea3-a454-05956d3985d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:19.262173 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c2989dc2-7613-4ab2-8f18-4d3610f9433b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:20.416368 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:21.799032 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:22.530552 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:29.204389 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:30.139266 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:39:46.895764 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c0a0750f-90fc-4759-b8c0-d7f3941bdf07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:49.267725 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-85d3222f-3a95-4782-8e86-9e21a86b9a46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:50.409910 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:51.810332 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:52.467722 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:39:59.215268 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:07.139455 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:40:16.929973 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-cf0b9360-a827-440d-b711-64317cdd2dfb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:19.260591 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-fd46b086-dd48-4810-bf3f-e95018f569e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:20.397857 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:21.798200 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:22.467086 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:29.209329 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:44.138862 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:40:46.940467 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6c1ad6bf-8dd4-4282-a10c-1ba2af8eb00f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:49.277673 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a8429906-0f91-4cf2-af22-dab4d961fc64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:50.425924 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:51.820394 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:52.460314 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:40:59.214508 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:16.911622 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-8a981b7f-adb9-41da-97d4-78a5f4c9e17b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:19.270001 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-3b9e73a1-0d9c-4c15-a787-443874abffa0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:20.418786 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:21.137083 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:41:21.791091 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:22.464579 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:29.208089 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:46.899597 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-575d3d75-78b1-4651-8b62-9f1db7c43888 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:49.259425 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-8d3da83c-f6f4-4654-9cd0-f3fd187fe5ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:50.469979 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:51.807695 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:52.470823 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:41:58.137010 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:41:59.240957 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:10.101562 dv-cinder-819007-2-iscsi neutron-server[103142]: DEBUG neutron.wsgi [req-6f9bc9e7-7b48-4f9a-8ce3-bf353677a57c req-dd96e45f-0558-44b7-965e-018478c1b4aa service neutron] (103142) timed out ('10.222.0.84', 52624) {{(pid=103142) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 16:42:16.915265 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-834b571a-9fbb-48c7-b7f0-b1a6f6b18247 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:19.293170 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-eb334167-ff08-4990-8b8f-1a8d998f8d4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:20.436111 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:21.794632 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:22.470472 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:29.235920 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:35.135878 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:42:46.915526 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-4be5e61b-e699-413f-8ab5-e264d564d165 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:49.292706 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-6a071f5a-6def-48f0-a182-be1587764197 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:50.429779 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:51.799673 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:52.468266 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:42:59.275853 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:12.134391 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 16:43:16.948874 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-629d8814-5007-4168-ab64-2d1e5908c7ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:19.280908 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-a14150be-fd88-4778-b41b-5097efb08166 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:20.423535 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-c13ddfd2-62f1-4b76-8297-adcf45f72d44 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:21.812531 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-29e95559-b42c-4ee7-ab58-5eaf0393f19b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:22.461370 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-73a359d1-926b-4512-8dcc-3695b9154399 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:29.281261 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-acbd5cbe-ac9d-4936-8961-31e15383b26b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:46.908914 dv-cinder-819007-2-iscsi neutron-server[103143]: DEBUG neutron_lib.callbacks.manager [None req-47402122-c471-4ba7-ae96-1fd7741d4ccf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8778970271937', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1385567'] for agent, after_update {{(pid=103143) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 16:43:49.133034 dv-cinder-819007-2-iscsi neutron-server[103144]: DEBUG neutron.db.agents_db [None req-4d42dfe5-46ae-4499-ba5e-6e41665d87d0 None None] Agent healthcheck: found 6 active agents {{(pid=103144) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}